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It IS such significant symbols, in the sense of a subset of social stimuli 
initiating a co-opeiative response, that do m a ceitain sense constitute 
our mind, piovided that not only the symbol but also the responses aie 
in oui own natuie What the human being has succeeded in doing is in 
oiganizmg the response to a ceitain symbol which is a pait of the social 
act, so that he takes the attitude of the other peison who co-opeiates 
with him It IS that wduch gives him a mind (p 190) 

G H Mead (1934) 

By GUI definition of man as an animal symbolic inn wc have aimed 
at oui fiist point of depaiture foi fuithei investigations That 
symbolic thought and symbolic behavioi arc among the most character- 
istic features of human life, and that the whole progress of human cul- 
ture IS based on these conditions, is undeniable But arc wc entitled to 
consider them as the special endow ment of man to the exclusion of all 
other organic beings^ Is not symbolism a pimciplc which we may 
trace back to a much deeper source, and which has a much broader 
range of applicability^ If we answer this question in the negative wc 
must, as It seems, confess our ignorance concerning many fundamental 
questions w^hich have perennially occupied the center of attention in 
the philosophy of human culture (p 27) 

Ernest Cassirer (1944) 

Now that the transcript of science has become so large that a single 
individual cannot hope to encompass a hundredth part of it in the com sc 
of a lifetime, the problem of order and economy m learning, that is, 
the transmission of the transcript into the image of the scientist, be- 
comes of overwdiclming importance We must ic-cxaminc the 
whole process of formal education from the point of view of w hat is 
the vmmmnn knowledge, not the maximum, winch must be transmitted 
if the whole structure is not to fall apart Any economizing of learning, 
therefore, is highly desirable Ficonics may be more of a contiibution 
to this restructuring of the universe of knowledge than it is a new^ sci- 
ence in the sense in w^hich the old sciences aic sciences If a single 
theoretical principle can be shown to apply over a wide area of the 
empirical world, this is economy m the learning pioccss (pp 162-163) 

Kenneth Boulding (1956) 





Within the whole lange of the behavioral sciences, tew developments 
have been so striking and significant duiing the past decade as those 
pertaining to the symbolic processes Primitive Behavioiism had no 
place foi noi mteiest in such phenomena Speech, like bchavioi in gen- 
eral, was seen as giossly instiumental, not mfoimative, and the \\ hole 
concept of knowledge and communication languished Howevei, as 
Behaviorism has come of age, attention has been iiresistibly draw n, once 
again, to these phenomena and to a broad spectium of pioblems with 
which earlier behavioi theory was not at all concerned The piesent 
book describes and inteiprets these developments 

Many collateial influences, extending from technical philosoph\ to 
the new branch of engineeiing known as cybernetics, have impoitantl\ 
stimulated and shaped contempoiaiy thought concerning the symbolic, 
or lepiesentational, piocesses But we shall heie be paiticulaily con- 
cerned with the unfolding of potentialities which lay within Behavioi- 
ism Itself While originally lepudiatmg all that was subjective and 
cognitive, this scientific movement has lecently shown itself unexpect- 
edly competent to deal therewith, in a framewoik which is at once moic 
systematic and seminal than any approach pieviously available In the 
beginning avowedly opposed to the study of “mental life,” Behatioi- 
ism has, paradoxically, piovided a new, film foundation and powciful 
inducement foi just such study 

The reader who wishes a detailed account of the scientific develop- 
ments which are antecedent to those delineated in this book should 
consult a companion volume, Lemmng Theory and Bchavio) (John 
Wiley & Sons, Inc, i960) In it the systematic conception of learning 



X PREFACE 

which, thanks to the combined effoits of many woikcis, has giadually 
emerged during the last twenty years is presented, against the backdiop 
of earher and less adequate, but still provocative, theories loday this 
newer, more inclusive scheme provides the conceptual substiuctuie for 
the contemporary analysis and better understanding of the “liighci,” 
symbolic processes with which this book is especially conccincd And 
the last chapter of Learning Theoiy and Bebavioi, which deals with 
generalization, consatutes a natural tiansition to the topic of mediation, 
as developed in Chapter z of this book It is, howcsci, b\' no means 
essential that the first book be lead as a picicquisitc Chaptci i ot tlie 
present volume summarizes the argument of the antecedent one, so 
that the advanced student need be at no disadvantage in going to w oik 
on this book durectly Also a phonographic iccoiding, which biiefU 
summarizes the thesis of the preceding book and exemplifies the eftetr 
of delayed auditory feedback on ordinary speech, is available from tlie 
author upon request, with the compliments of the publisher ot these 
two volumes 

Because the widespread interest in symbolic operations and com- 
mumcation is of relatively recent origin and still gi owing, the question 
of scope and orgamzation of this book has been a ditficult one 1 he 
reader will find that some much-publicized developments, c g , those 
pertaimng to so-called “information theoiy” and “gencial semantics,” 
receive scant attention, whereas certain unconventional topics, c g , 
statistics and probabihty theoiy, have been accentuated Tlic wiitci 
has no strong defense for this parucular pattern of inclusion and ex- 
clusion The whole arrangement is frankly experimental, and sui>gcs- 
tions and criticisms from readers will be gratefully received 

Some leaders may be surprised that only in the final chaptci of rlic 
book IS any extended attempt made to consider the field of ps\ chopath- 
ology Because of frequent past efforts to exploie the iclationship 
between learmng theory and psychopathology, this limitation ma\ 
seem particularly odd But as one immerses himself in tlic liistoi\ of 
the psychology of leaimng, it becomes ever cleaiei that main of the 
earher attempts to “apply” learmng theoiy to this lealm wcie, of neces- 
sity, premature and naive, if for no other reason than that oui undci- 
standing of learmng in general, and of the symbolic processes in pai- 
ucular, has been so partial and so incomplete Some of the conceptions 
of learmng which have been used most confidently in this connection 
are, in the present work, found to be seriously deficient and mislcadino 
Besides, the specific and detailed issues of psychopathology he bc\ ond 
the scope of the title of this volume, properly speaking It is hoped that 
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this book may nevertheless be “propaedeutic” with respect to the field 
m question 

Because of the exploratory nature of this book and the general fomen- 
tation of the field which it represents, its “audience” cannot be pre- 
cisely foiecase However, its possible uses as a supplement to Lear7img 
Theory and Behavior and as a basic text in more advanced work in 
the psychology of learning arc obvious Moieovei, special courses in 
communication and the symbolic processes (“Psycholinguistics”) aic 
beginning to appeal in both the collegiate and giaduate curiicula, foi 
which this book can also appropiiately serve as a text, and specialists 
(and students) in such cognate areas as education, speech, logic, human 
engineering, psychiatiy, and the social sciences geneially should find 
relevant “collateral” reading here The writer will be grateful for 
readers’ comments as to how the cogency and usefulness of this volume 
can be expanded 

Here I also wish to call attention to the various acknowledgments 
previously made in the Preface of Learning Theory and Behavior, 
which apply with equal cogency to the present volume, and to indi- 
cate, in addition, my appreciation to those authois and publishers (fully 
recognized in the Bibliography) who have generously gi anted permis- 
sion for the repioduction of quotations and illustrations m these two 
books As IS so often the case in book making, the end result is a bioadlv 
social product 

O HoBun Moamur 

Urbana, llhnois 

Jime, ipSo 




Contents 

1 Resume and hit} oduction 1 

2 Latent Leatning, Vunnhment^ and Extinction and the Con- 
cept of Mediation 29 

3 Learning Theoiy and Language Learning The Pioblem of 

‘^bnitatioif'^ 70 

4 Language and Learning The Psychology of Signs and Sen- 
tences 1 1 7 

5 Imagery^ Memoiy, and Attention {Obseiving Reactions) 163 

6 Learning, Thought, and Insight 208 

7 Learning Theoiy, Cybernetics, and the Concept of Con- 
sciousness 252 

8 Learning, Causality, Piobability, and Statistics 293 

9 Learning, Causality, Piobability, and Statistics {continued) 325 

1 0 Social Learning and Human Pei sonality 359 

Bibliogi aphy and Aiithoi Index 421 

Subject Index 457 


Xlfl 




1 


Resume and Introduction 


Readers who are familiar ^\lth the authoi’s Learning Theoiy and Be- 
havior (i960) may wish to omit the piesent chaptei, beginning the 
systematic study of this volume with Chapter 2 Or, they may wish 
to use this chapter as a means of leviewing and consolidating then 
knowledge of the earliei book and of tying it m, the moie diicctl>, 
with what is to follow But in any event, then peiusal can be lapid and 
in no way arduous On the other hand, peisons who have not pre- 
viously read Learning Theory and Behavior will find this chaptci moic 
essential and warranting quite careful study With close attention, 
they will find it a sufficient preparation for the ensuing ones And if 
not, they can revert to the antecedent volume, whose ccntial argu- 
ment is most fully expounded in Chapter 7 Other chapters in the 
preceding book can then be read, 01 not, as special inteiest and need 
suggest 

I From Introspection to Behaviorism 

The beginning of the 20th Centuiy found x\mcrican ps\cholog\ 
undergoing a major transformation Since its founding as an independ- 
ent science, some twenty-five years eailici, ps\chology hid been 
largely preoccupied w^th “the study of consciousness, pei and its 
method was mainly that of introspection Some s\stcmatic knowledge 
was thus acquired, especially as legaids sensation and perception, but, 
for the most part, the approach had proved limited and unpiodiicnve 
This was particularly true of the psychologv of learning 

Already, m 1896, Dewey had piedicted that the New Ps\chologv 

I 
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would be based upon the concept of the reflex aic — a picdiction x\ Inch 
proved to be well founded Soon the woik of Pavlov on “conditioned 
reflexes” was to arouse world-wide mteiest, and Thoindikc x\as to in- 
troduce a theory of habit which, in a rather diffeicnt sense, wxis equally 
reflexological 

Both of these developments weie stimulated and influenced bt the 
evolutionary thought of Chailes Daiwin Pavlov (1927) diiectU le- 


knowledged his debt to Darwin and was at pains to shm\ how the r\ pe 
of learning which he termed conditioning aids an oiganism in its stiug- 
gle for existence Thorndike was less explicit on this scoie, but Camp- 
bell (ig; 6 z, 1956b) has recently pointed out that the Law of fleet is 
concerned with the survival and nonsuivival of paititiilai 
just as the theory of evolution is conceined xvith the siii vital 01 non- 
surtuval of individual orgamsms 

The psychology of mtiospection (or so-called Stiuctuialism) Ind 
been concerned with consciousness Pavlov and Thoindikc wcic con- 
cerned with objectively obseivable stimuli and responses It was thcic- 
fore not surprising that Watson (1914, 1919) should have coined and 
popularized the name, “Behaviorism,” for the new mot cincnt 


Although they were alike in that they were both behatioiistic (and 
essentially “reflexological”), the views of Pavlov and those of 1 lioi n- 
dike were in other respects quite diffeient Learning, as Pit lot con- 
ceived It, was entirely a matter of stmmbn siihstitvnov By tlic pined 
presentauon or occurrence of two stimuli— an originally nciiti il 01 
“meaningless,” one with another which already has the cipacitt to 
elicit a particular reaction — this reaction, according to Pat lot , gets con- 
nected with, or “conditioned” to, the formerly neutral srinuihis \nd 
sinc^in order for this process to take place, the oiigmallt nciirial 
(ineffective) sumulus must occur first, somewhat in adtance of the 
other (already effecuve) stimulus, the originally ncutial stimulus nut 
be said to act as a signal, so that, m conditioning, the oiganism leiins 
to respond to signals, as well as to the things thus signified ITcnce, it 
IS understandable why Pavlov stressed the adaptive, hfc-picscitimr 
imphcations of this type of learmng or behavior change 

Thorndike saw learning as a mattei of snhstitu- 

t m It was not, he believed, so much a matter of an oiganism’s com- 
ing to make the same response to a new stimulus as it was''of its coniimr 
to inake a new response to the same stimulus If, foi example a put 
ocular somulus (such as hunger) causes an animal to make a lespOnst 

reducing), well and good the connec- 
, or bond, between that stimulus and that lesponse ougiit to be 
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and piesumably is, strengthened But what a misfortune it would be if 
an organism kept repeating a useless oi actively harmful response^ 
Obviously oiganisms need and apparently have a device for getting 
rid of, or “disconnecting,” such responses This Thorndike called pun- 
ishment or “stampmg-out ” Thus it is, reasoned Thorndike, that if one 
response to a paiticular stimulus does not woik or woiks adveisely, 
the oiganism can get rid of it and, thiough “tiial and eiioi,” find and 
fixate a better one 

n Both Pavlovas and Thorndike's Theories Inadequate 

Here, then, were two almost diametrically opposed conceptions of 
how learning operates, with a body of scientific as well as common- 
place observations to support each of them Psychologists, heie in 
America and the woild over, either “took sides” and sought to defend 
one position to the exclusion of the other or wondeied if, despite their 
seeming incompatibility, they might not both be tiue The lattci pos- 
sibility is what may be tcimed the fiist two-factor oi two-pioce^s con- 
ception of learning 

In 1932, E C Tolman published a book in which he took the posi- 
tion that all learning is sign learning, 1 e , that it is simply a matter of 
new meanings 01 “cognitions,” lathci than overt responses, getting 
connected to appropriate stimuli Given such a change in the “cog- 
nitive structure” or “psychological field” of the learner, moie 01 less 
appropriate changes in behavior weie assumed, somehow, to follow 
Just how mere “knowledge” could instigate and control behavior w^as 
never fully explicated, a fact that prompted Guthiie ( 19^2) to icmaik 
that Tolman’s theory left the subject “lost in thought” instead of get- 
ting him to his goal 

Roughly a decade later, Claik L Hull (1943), eschewing the sub- 
jectivism which Tolman (while still calling himself a Bchavioust) had 
allowed to cieep into his theory, made an effort to unify the obsciva- 
tions of Pavlov and Thorndike in a different way Wheicas Tolman 
had taken conditioning (he called it sig 7 i learning) as basic ind tiicd to 
derive trial-and-eiroi behavior therefrom, Hull, turning tire tables, 
took trial-and-erioi (Thoindikian) learning as basic and tiied to make 
conditioning a by-pioduct thereof 

Here it wnll not be necessaiy to indicate just how Hull appi cached 
this task 01 wherein his endeavor w^as unsuccessful It w ill suffice to siy 
that in 1947, picscnt wuitei, incoipoiating the icseaich and think- 
ing of a number of in\estigatois, suggested 1 second \eision of two- 
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factor theory (actually the first to cany this designation), winch con- 
tinued to posit a fundamental distinction betwxen s/g7? lemmng^ on the 
one hand, and solution learning on the other, but winch also involved 
certain important departures fiom the way m w^hich Pavlov and Thorn- 
dike had, respectively, defined them Some of the woik on so-callcd 
‘^avoidance learmng” was particularly influential in shaping this new ci 
two-factor position Various studies had by then made it clcai that 
neither the Pavlovian noi the Thoindikian hypothesis, taken alone, 
could explain all the relevant facts Pavlovian theoiy fell dow n in that 
the final behavior shown by a subject m avoidance learning mas be 
quite unlike the behavior which the organism manifests in i espouse to 
the “unconditioned” (traumatic) stimulus, m the event that this lattei 
stimulus IS not successfully “avoided” Hence, the idea that Icainmo 
is just a matter of one and the same response being shifted to a new 
stimulus seemed to collapse And Thorndike’s notion that Icainmo is 
instead a matter of response substitution also w as impugned by "the 
fact that, in avoidance learning, appaiently the fint thing the subject 
learns is to be afraid of a foimerly neutial stimulus, and this, ob\ lously, 
does not occur on the basis of trial and eiior it is a mattci of stiaight 
conditioning or “contiguity” learning The subject evidently icacts 
to the “danger signal,” puiely and simply, because that signal has been 
temporally associated with (made “contiguous” to) the thing oi event 
It signalizes Here, it seems, is a clear and undeniable instance of 
stimulus substitution, le, conditiomng These consideiations piomptcd 
the formulation of the “second” two-factor theory along lines to be 
sketched in the next section 


III The Two-Factor Position (Second Version) 

When a buzzer sounds in the presence of a laboratoiy animal and 
the animal then receives a brief but moderately painful electnc shock 
we can be sure that the reaction of fear, originally aiouscd bv the 
shock, will, after a few painngs of buzzer and shock, start occuiiiim to 
the buzzer alone Here the buzzer becomes a sipi that shock is*im- 
minent, but no “solution” is yet in sight Only when the subject, now 
motivated by the secondary (acquired, conditioned) diive of fear 
starts behaving (as opposed to merely feeling) is he likely to hit upon 
some response which will “turn off” the danger signal aid enablfthc 
subject to avert the shock This, however, is no longer conditiomno- oi 

Here .t seems that the°„b- 
ject first learns to be afraid and then what to do about the fear These 
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stages or steps weie assumed to involve two sepaiate and distinct kmds 
of learning sign learning, i e , the process wheieby the feai gets 
shifted from the unconditioned to the conditioned stimulus, mid solu- 
tion learning, le, the piocess wheieby an oiganism acquiies the cor- 
lect, effective instiumcntal i espouse needed to lessen oi eliminate the 
fear 

This icvised “tw^o-factof ’ oi “two-step"’ vva\ of thinking about 
learning had some impoitant advantages, chief among which is that it 
piovides an impiovcd thcoiy of “punishment” If an external, expcii- 
mentei-conti oiled stimulus, like a buzzei, acquucs the capacity to 
aiouse feai as a icsult of having been paiicd with cicctiic shock (oi 
some othei foim of painful stimulation), w^ould theie not also be a 
form of feai conditioning w Inch w oukl occur w hen a shock follow s 
something the subject docs^ Thorndike had assumed that when a 
stimulus-i espouse sequence is followed by punishment, the lattei acts 
in such a w^ay as to weaken the pathw a\ betw ecn stimulus and i espouse, 
just as a icward was supposed to sticngthcn this “connection ” But it 
IS obvious, even to casual obseivation, that the most immediate and 
leliable “effect” ol behavior is ncithci punishment noi icwaid but, 
lather, the stimuli (sensations) associated with the occuiicnce of the 
behavior itself Now' if these icsponsc-coii elated foims of stimulation 
are followed by an event such as elcctiic shock, they will, bv the 
piinciple of conditioning, themselves become capable of aiousing feai, 
which can be allayed only if the subject inhibit the i espouse which 
aiouses them In othei woids, if a lesponse has been “punished,” when 
the subject latci stai ts to icpcat that i espouse, it will aiousc pi opuoccp- 
tive, tactile, visual, oi othei foims of stimulation v\hich will act as 
“dangei signals"’ and will tend, thiough the feai thc\ elicit, to block 
the 1 espouse 

This mtcipictation ot punishment was an impiovemcnt ovci Thorn- 
dike’s stamping-out conception thcieot, toi it took into account the 
possibility of conflut If a punisliment acted as Ihoindike supposed, 
then a habit, when subjected to punishment, would quietlv tade aw as , 
deteriorate, whcicas we know that living oiganisms do nor give up 
established modes of giatdication without a snuggle 1 he notion tint 
punishment causes feai to become connected to lesponsc-coi i elated 
stimuli is compatible with the obscivcd tacts and piovides common 
ground, winch had not existed befoic, between learning theoiy and 
clinical psychology 

Although “avoidance"" learning w as hist studied in situations in w Inch 
the “vvMimng"’ stimulus comes horn the external cnviionmcnt, it was 
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soon evident that, in prinaple, the situation is no different wheie the 
warning stimulus or stimuh are inherently associated with the subject’s 
own activity In the one case, fear gets conditioned to an independent 
stimulus or situation which the subject can peihaps flee fiom or manage 
in some other way, while in the other the fear gets conditioned to 
res-ponse-aroused stimuh which can occur only when a particular re- 
sponse occurs and can best be eliminated by cessauon of the acuvity 
in question Both of the forms of behavior cited involve “avoidance” 
but, in the one case, avoidance by “doing something” and, in the other, 
by not “doing something ” In the one situation the subject may be said 
to get “pumshed” if he does not perform a particular response, whereas 
m the other he gets pumshed only if he does perform some specified 
response The first may be termed active avoidance learning and the 
second, passive avoidance learmng 

Here, clearly, is a way of thinking which has “power” by means 
of the same principles (fear condinomng followed by solution learn- 
mg), one can account for two such seemingly diverse phenomena as 
flight and behavior inhibition But there are also some inherent weak- 


nesses, and in order to see these most clearly (in Section IV), it will be 
desirable to note the sahent ways in which this second version of 
two-factor learmng theory differed from the first The first version had 
taken the views of both Pavlov and Thorndike moie or less at face 
value, whereas the second version made certain impoitant modifica- 
tions Pavlov had completely by-passed the pioblem of motivation and 
had tried to derive a wholly objective science of behavior from the 
concept of stimulus-substitution, in the second two-factor theoiy, it 
was assumed that what conditiomng does, pre-eminently, is to attach 
fears to formerly neutral (mdependent or response-dependent) stimuli 
and that these fears then instigate trial-and-error behavior along hnes 
very similar to those suggested by Thorndike However, trial-and- 
error theory was also modified in two important ways (i) wheieas 
Thorndike had been interested almost exclusively in primary drives 
such as hunger and thirst, the new two-factor position stressed the 
possibihty of tnal-and-error learmng in response to secondary, as well 
as primary, dnves, and (2), on the assumption that fears (once con- 
ditioned) may act as motivators and their reduction as reinforcers a 
new conception of pumshment (as well as active avoidance) emerged 
which was very different from the one advocated by Thorndike 

though ths second version of two-factor theory thus had much 
0 recommend it, it, too, was mcomplete in certain important ways 
which will be considered in the next section ^ ^ 



RESUME AND INTRODUCTION 


7 


IV. Secondary Reinforcement as ^^Hope^^ 

The two major weaknesses in the second version of two-factor learn- 
ing theory were (a) that it did not adequately deal with what is now 
known as secondary reinforcement and (b) that it continued to 
accept, essentially unmodified, Thorndike’s “bond” (reflexological) 
theory of habit As already indicated, Thorndike’s “stamping-out” con- 
ception of punishment has been generally replaced by a conflict, or 
“feedback,” theory thereof, and Tolman, Lashley, Lewin, and other 
influential psychologists had for years been pointing out that mosn of 
the supposedly “habitual” (learned) behavior of man and beast alike 
IS far more flexible and richly variable than a strictly connectionist view 
could account for (see also Woodworth, 1958) According to Thorn- 
dike’s view, an organism can learn only what it does^ 1 e , a particular 
stimulus-response connection has to “occur” before it can be strength- 
ened (or weakened), but experiments on latent learning and extinction, 
insight, and other mediated forms of behavior modification (see Chapter 
2) have shown that learning can occur without “doing,” thus impugning 
the generality of the connectionistic position Yet, for want of a better 
conception of what is involved in habit formation, two-factor learning 
theory (although rejecting his theory of punishment) continued to 
accept Thorndike’s rather mamfestly inadequate conception of habit 
as an S — bond which is strengthened by reward As it turns out, 
recent studies which have served to clarify the nature of secondary 
reinforcement have also provided the basis for a new and superior 
theory of habit 

Many years ago, Pavlov and his collaborators demonstrated what 
they called second-order salivary conditioning If, for example, a 
blinking light is presented just before a hungry dog receives a bit 
of food, the salivary response which the food elicits (more or less 
reflexly) “moves forward” and starts to occur to the light alone This 
is the familiar phenomenon of having one’s “mouth water” at the 
sight, smell, or sound of food and lepresents what Pavlov called first- 
order conditiomng Then it was found, to continue with the same 
laboratory example, that the light, once the salivaiy lesponse has been 
conditioned to it, can be paired with a new stimulus, e g , the ticking 
of a metronome, and that, by this means, the salivary 1 espouse can 
be transferred to the sound of the metronome, without the latter having 
ever been paired with the “primary” or original remforcer, food In 
other words, Pavlov showed that once the salivary response has been 



8 LEARNING THEORY AND THE SYMBOLIC PROCESSES 

conditioned to a “first-order” conditioned stimulus, that stimulus 
can serve as the “unconditioned” stimulus for “second-order” con- 
dmomng 

Then, somewhat later, particularly as the result of researches in this 
country, it was found that a first-oider conditioned stimulus can serve 
as a “secondary reinforcer” (the terminology is unfortunate but now 
conventional) in yet another sense Let us suppose that a hungry dog 
has been taught, by the procedure indicated, to salivate upon the oc- 
currence of a blinking light And let us further suppose that provision 
is now made so that the dog himself can turn on the light If given a 
convement opportumty, will he do so? He will, repeatedly — thus in- 
dicating that a first-order conditioned stimulus can serve as a secondary 
reinforcer, not only in the sense of establishing higher-order salivary 
conditiomng, but also in the sense of setting up new habits If the 
blinking hght can be turned on by nosing a “button” or pressing a lever 
with Its paw, the dog will show a much more marked tendency to make 
such a response than if it produces no such stimulus What is happemng 
here is that the dog learns a new bit of behavior, not because that be- 
havior produces (is rewarded by) food, but because it produces meiely 
a sign, or promise, of food How can this finding be explained? 

In their study of sahvary condmomng, Pavlov and his co-woikers 
had been zealously objective and had meticulously limited then ob- 
servations (or at least their scientific reports) to the action of the 
sahvary gland, to the neglect of the dog-as-a-whole As ^result of 
conditiomng expenments which were conducted and reproduced as 
monon pictures by Carl Zener (1937), it was demonstrated that a 
hungry dog, upon hearing or seeing a stimulus that signalizes food, 
not only sahvates, the dog looks interested, hopeful, even “happy” and' 
if not physically restrained, will move bodily toward the place where 
the food IS hkely to be dehvered 

From this and related observations it was justifiably inferred that, in 
a situation of the kind described, a conditioned stimulus not only- 
makes the subject salivate it also makes him hopeful, just as surely as 
a stimulus which has been associated with onset of pain makes a sub- 
ject fearful And if a fear-arousing stimulus elicits the two forms of 
avoidance behavior previously discussed, it might be surmised that a 
hope-arousmg stimulus would be capable, hkewise, of producing either 
of two forms of “approach” behavior, one of which has already been 
alluded to and which, in ordinary life, is exemphfied by the family dog 
coming “when called” Just as an orgamsm wishes to get less of a 
stimulus that makes it afraid (cf Holt’s concept of abience, 1931) and 
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may do so by fleeing, so will an orgamsm try to get more of a stimulus 
that arouses hope (Holt’s adtence) and may do so by going toward 
the source of that stimulus Hence we emerge with an understanding 
of what has been called positive and negative place learmng (spatial 
approach and avoidance) 

But there is manifestly more to the story, which leads to a new 
conception of habit formation 

V A Feedback Theory of 

In Section III of this chapter we have seen how the study of “place- 
avoidance” learning led to a new and apparently improved conception 
of pumshment (response avoidance or inhibition) And in the preceding 
section, reference has been made to recent work on secondary lein- 
forcement as it pertains to “place-approach” learning Does not this 
work on, and way of thinking about, secondary reinforcement now 
suggest a conception of positive behavior modification or “habit forma- 
tion” which IS as radical as was the change from Thorndike’s “stamping- 
out” theory of punishment to the “conflict” model which is now so 
widely accepted^ 

If a formerly neutral stimulus is paired with a rewarding state of 
affairs (drive reduction), that stimulus acquires the capacity to act as a 
secondary remforcer and to attract the subject toward it The subject 
acts as if It wants to get more of the stimulus, and since the stimulus 
IS commonly one which is located at some point remote fiom the 
subject, the subject’s reaction is, of necessity, often one of approach 
(Mowrer, i960. Chapter 9) The biological utility of such a piedis- 
position on the part of living organisms is obvious it carries them into 
the vicinity of probable primary reinforcements and lewards 

But now let us suppose that the stimulation which precedes a re- 
warding state of affairs is response-produced^ rather than environmen- 
tally produced Let us suppose, that is to say, that a hungry animal 
makes a particular response, theieby stimulating itself in a characteris- 
tic manner, and obtains food By principles already enunciated, we 
would expect the response-correlated stimulation to take on secondary 
reinforcement properties and that the subject, when again hungry, 
would now try to “get moie” of these (“promising”) stimuli What 
would be the result^ Since these “promising” stimuli are not located 
in space, the subject could not get more of them by going to any 
particular place The only way to arouse or intensify them is for the 
subject to make or accentuate the response that has previously pro- 
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duced them’ And the tendency to make a particular response^ in the 
presence of a particular drive or need^ is what is ordinarily termed 
a ''habit ” 

According to Thorndike’s classical statement of the Law of Effect, 
a habit consists of a strong “connection” between a particular stimulus 
or drive and a particular response Although this connection was often 
said to be merely “functional” (or even “mathematical”), without 
necessarily implying anything about neural pathways, it was very 
natural to assume that the theory did presuppose the direct strengthen- 
ing of neural connections How otherwise was one to inteipret the 
notion of a “connection”^ The conception of habit just suggested is 
different in that it presupposes only that there is an impioved or 
strengthened connection (a specifically neuial connection rather than 
just a vaguely “functional” one) between certain end organs which 
are excited in specific ways by a given response a7id the emotion of 
hope Hope is something which motivated organisms like to have (since 
It implies imminent drive reduction), just as fear is something they do 
not like to have (since it implies a threat of drive increase), so that 
we may legitimately infer that a motivated orgamsm will show a 
strong tendency to make those responses which have, as one may say, 
a hopeful “feedback ” The tendency to seek response-correlated stimu- 
lation which arouses hope is biologically useful in that it disposes a 
motivated organism to make responses which m the past have led to 
(or produced) satisfaction Thus, as between the tendency noted 
earlier for living orgamsms to seek external stimulation which has been 
associated with reward and the tendency, just described, for them to 
seek self -pro duced stimulation which has been associated with reward, 
we have at least the rudiments of an explanation for goal-seekino- be- 
havior m general ^ 

VI. Symmetry and Scope of the System 

Behavior, we thus discover, consists of two types of appioach and 
avoidance tendencies If an independent stimulus arouses fear, flight 
IS likely to follow, whereas response-correlated stimuli wbch' arouse 
fear produce inhibition And if an independent stimulus arouses hope, 
approach will occur, whereas response-correlated stimuh which aiouse 
hope produce response facihtation or “habit” And wheie response 
facihtation or response inhibition is concerned, it is not that a dnect 
drive-behavior bond is either strengthened or weakened, instead it is a 
matter of the hope or fear that has gotten conditioned to the stimuli 
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which are typically aroused by the occurrence of a particular pattern 
of action 

Stated most concisely, the thesis is that much of the ad)ustive, self- 
regulatory behavior of living organisms can be subsumed under four 
rubrics the avoidance of places and the inhibition of responses which 
have been negatively (incrementally) reinforced and the approach 
to places and the facilitation of responses which have been positively 
(decrementally) reinforced Thus the question of whether living or- 
ganisms learn “responses” or “places” is resolved by the discovery that 
they are capable of and constantly manifest both forms of learning, 
which, however, involves one and the same set of principles namely 
the conditioning of hopes and fears, under the impact of drive decre- 
ments and drive increments, to either independent or response- 
dependent stimuli This way of thinking cuts the ground from under 
the controversy between “reinforcement theorists” and “field theorists” 
and provides the basis for a conceptual scheme of considerable gen- 
erality and power (Mowrer, i960, Chapter 9) 

This is still a two-factor, or two-process, conception of learmng, 
but It differs from the preceding (second) version in certain important 
ways The earlier version distinguished between sign leaimng and 
solution learmng, the new version assumes that all learmng is sign 
learning, or conditioning, and that solution learning (including in- 
hibition) is a derivative or special case thereof Wherein, then, is the 
theory still two-factored^ It is still two-factored in that it assumes 
that there are two quite different forms of reinforcement drive decre- 
ment (reward) and drive increment (punishment) In this respect the 
theory is congruent with common sense and with important aspects of 
many other psychological systems (see Section XII), but it deviates 
from the thesis of Hull (also favored for a time by Thorndike, 1931, 
1932) that all reinforcement is decremental, and while agreeing with 
Tolman that all learning is sign learning, it is more “dynamic,” less 
purely “cognitive ” Finally, the new conception accepts “Pavlovian 
conditiomng” as basic, but it goes considerably beyond Pavlov in stress- 
ing the essentially emotional (motivating and reinforcing) nature of 
conditioned responses, and it also holds that overt, instrumental be- 
havior is much more complexly determined than Pavlov’s (essentially 
reflexological) position assumed 

Thorndike’s bond theory of habit was, in one respect, perfectly 
straightforward and scientifically impeccable It assumed that a stimulus 
impinging at one end of an S — R connection or “channel,” as cause, 
produced at the other end, as effect, a behavioral reaction of some kind 
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In this sense, then, it could not be accused of implying teleology 
(causation from the future), but the charge often leveled at it— and 
with good reason— was that it made Imng orgamsms, per theory, 
“bhnd” and “stupid” to a degree which their actual behavior behes 
In insisting that animals (including human beings) learn only by doing, 
the theory precluded insight, foresight, and “latent” learmng in general, 
which phenomena the present theory accommodates very comfortably 
(see Chapters 2 and 6 especially) But, in accomplishing this, the theory 
may seem to have lost its mechamstic moorings However, as will be 
seen in Chapter 7, the new science of cybernetics (Wiener, 1948), with 
Its emphasis upon “feedback,” gives us now an excellent model for 
explaimng (and, indeed, producing) “teleology” in a thoroughly 
“mechamcal” way Pending the fuller discussion of this problem in 
the chapter cited (see also Mowrer, i960. Chapter 7), the reader will 
perhaps wish to suspend judgment concermng it But a crude, intuitive 
grasp of what is involved can be had from the proposition, derived 
from the new theory, that, for example, an orgamsm engages in food- 
seeking and food-consuming behavior not only because it is hungry 
but also because, in instituting (or perhaps just “contemplating”) such 
behavior, the orgamsm already “feels better” (see Section XI) Thus, 
in a manner of speaking, the orgamsm is not only pushed but also 
“pulled” toward previously successful activity, in the sense that the 
“pressure” (to shift to a pneumatic analogy) becomes less when there 
IS movement (of at least a s)mibolic kind, see Chapter 6) toward the 
goal and again greater when the movement is stopped or reversed 
Because we have been so accustomed to think about behavior in terms 
of the mechamcs of the 19th century, it is difficult to assimilate the 
implications of the new conceptions suggested by 20th-century me- 
chamcal and electromc “control systems”, but these, as a little study 
will show, are vastly more relevant to the understanding of the behavior 
of hving orgamsms than are the “push-button” models of an earlier 
day 


VII. Two-Factor Theory and the Present System Compared 

Because it is not always easy to see precisely how the present con- 
ceptual scheme differs from the earlier “two-factor” positions, and 
because it is important that theie be no ambiguity about this difference, 
this section will reproduce a discussion from an earlier study (Mowrer, 
1956) which goes into this matter in some detail 
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The original [actually the second} version of two-factor learning theory 
now appears, m retrospect, as a sort of stepping stone, intermediate be- 
tween monistic mterpretations and the revised two-factor position here 
presented The systematic relationships here involved may be summarized 
as follows 

Thorndike’s Law of Effect is schematized m Fig i-i and the Pavlovian 
conception of conditioning is represented m Fig 1-2 Each alone, accordmg 
to Its exponents, was capable of accounting for the basic facts of learning, 
but others felt that both conceptions were necessary Two-factor learning 

Rj reward punishment 


Sd Ri Sd R, 

Fig T-1 Schematic representation of the two halves, or aspects, of Thorndike’s 
Law of Effect It held, in essence, that if some drive stimulus Sd produces some 
instrumental (behavioral) response Ri, and if Ri is then followed by reward, 
this Sd — ^Ri sequence, or bond, will as a result be strengthened (diagram at left) 
and that if such a stimulus-response sequence is followed by punishment, the bond 
will as a result be weakened (diagram at right) 



Su ^R Sc R 

Fig 1-2 Schematic representation of conditioning, as conceived by Pavlov Sc is 
a stimulus which, initially, is not capable of eliciting response R, but which as a 
result of contiguous occurrence with Su (above, left), acquires this capacity (above 
right) The subscripts c and u are used to designate, lespectively, what Pavlov 
termed the “conditioned” and the “unconditioned” stimulus 

theory, as envisioned a decade ago, accepted, essentially unmodified, the 
“first half” of the Law of Effect, which held that reward strengthens habit, 
but It departed from the Law of Effect in holding that punishment achieves 
Its action, not by simply reversing the effects of reward, but by causing fears 
to become attached (conditioned) to stimulation associated with the oc- 
currence of the punished response This version of two-factor theory is 
shown in Fig 1-3 Here habit formation, or solution learning, is conceived 
essentially as Thorndike suggested, but punishment is seen in more complex 
terms Instead of simply reversing the effect produced by past reward, 
punishment is here thought of as providing the basis for the conditioning of 
fear, which then produces conflict and, if the fear is strong enough, in- 
hibition 
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The details of this interpretation of punishment are shown at the right 
in Fig 1-3 Here a problem situation or drive, S^, produces an overt, mstru- 
mental response, R. is followed by punishment, which is here represented 
as Sp The punishment elicits a response Rp of which tf, or fear, is a com- 
ponent But when R, occurs, it not only produces the extrmsic pumshment, 
Sp, It also produces a number of other stimuli, s, s, s, which are inherently 
related to the occurrence of R, The result a part of the reaction produced 
by Sp, namely fear, gets conditioned to these response-produced stimuli, s, 
s, s Consequently, when Sa recurs and the organism starts to perform R„ 
the resulting stimuh “remmd” the organism of the antecedent punishment, 
1 e , cue off Tf, which tends to inhibit R, 


S 

Rj reward ® 

s — (rf) 

Sp Rp 



Fig 1-3 Schematic representation of the second version of two-factor learning 
theory According to that formulation, habits were made by reward, as shown 
at the left, in essenaally the way suggested by the Law of Effect However, punish- 
ment was assumed to mvolve fear conditioning, as shown at right, with ensuing 
conflict and probable mhibition (see text) 


Two-factor learning theory, m its middle version, thus accepted Thorn- 
dike’s conception of habit formation but derived the phenomenon of punish- 
ment from fear conditioning, rather than attributmg it to a process which 
simply reversed the effects of past reward As has been shown, this theory 
of pumshment involves the same prmciples as have been found most satis- 
factory for explainmg so-called avoidance learning In both instances, fear 
becomes conditioned to stimuh, either external or response-produced, and 
the organism then makes whatever type of adjustment will most effectively 
eliminate these stimuh and reduce the attendant fear 
Current two-factor theory is diagrammed in Fig 1-4 Here it is assumed 
that habit formation is a matter of conditioning no less than is punishment 
If a stimulus, Sj, produces a given response R^, and if is followed by re- 
ward Sj., then It is assumed that a part of the total response, Rj,, which is 
produced by Sr will become conditioned to the stimuli inherently con- 
nected with Rr Here the conditionable component of Rj is r^, the “hope” 
(secondary reinforcement) reaction, and it becomes connected to stimuli, 
s, s, s, just as fear does in the case of pumshment The result is that when- 
ever Ri starts to occur, it is facilitated rather than inhibited (pp 121-123) 
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Perhaps the best way to epitomize the difference between the second 
and the present version of “two-factor” learning theory is as follows 
The second version was “two-factored” m two different ways it dis- 
tinguished between sign learning and solution learning and between 
incremental reinforcement and decremental reinforcement, sign learn- 
ing being associated with incremental reinforcement and solution 
learning with decremental reinforcement Now the theory is two- 
factored in only one way, namely, with lespect to types of reinforce- 
ment, incremental and decremental With regard to the other principle 


Sd* 



Sd 




S-— ^(rf) 

Sp Rp 


Sd Ri 



Sd R, 





Fig 1-4 Schematic representation of revised two-factor theory Here the changes 
produced in behavior by reward, as well as those produced by punishment, are 
derived from conditiomng plus the feedback principle 


of classification employed in the earlier versions, the theory is decidedly 
one-factored that is, it assumes that all learning is sign learning and 
that solution learning (as well as response inhibition) is a deiivative 
thereof In short, as far as “types of learmng” are concerned, the 
current version is “one-factored”, but it remains definitely two-factored 
as regards reinforcement This is perhaps not a very good or sufficient 
basis for deriving a name for the present theory, but, for the time being 
at least, two-factor learning theoiy can serve as well as any other, 
provided that it does not imply two kinds, or forms, of learning, simply 
two kinds of reinforcement ^ 

^ Another terminological matter should be mentioned here The reader may find 
It awkward to use the term “incremental” to designate the form of reinforcement 
involved in punishment (drive induction) and thus likely to produce active or 
passive avoidance behavior, and to use the term “decremental” to designate the 
reinforcement which reward (drive reduction) provides and which typically 
results in behavior facilitation In other words, confusion may arise from the 
fact that decremental reinforcement commonly produces what is sometimes called 
“response increment” (habit) and incremental reinforcement often produces “re- 
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Vlil The Nature of Unlearning 

Thorndike had a definite and simple, though probably mistaken, 
conception of unlearning It was the process of “connection” weaken- 
ing which resulted, as he beheved, from pumshment And Pavlov saw 
unlearning as involving either of two processes extinction or counter- 
condmomng A conditioned response, he found, will eventually stop 
occurring if it is not occasionally confirmed, or “reinforced,” by the 
occurrence of the unconditioned stimulus That is to say, if a promise 
(sign of reward) or a threat (sign of pumshment) is repeated over 
and over again and not at least occasionally substantiated, or “made 
good,” one would certainly expect the subject to stop responding to 
continue mdefimtely to react to no longer valid signs would not be 
biologically useful And Pavlov repeatedly showed, by laboratory ex- 
periment, that extinction is a very defimte and real phenomenon Also, 
what is equally plausible, he showed that the response to a conditioned 
stimulus or sign can be modified by means of counterconditiomng 
Thus, if a sign has originally meant reward and if conditions are changed 
so that It now means pumshment, we would expect the reaction pro- 
duced thereby to change from hope (salivation, in Pavlov’s experi- 
ments) to fear (Pavlov spoke of “defense reactions”) — or vice versa 
But as we have now seen, neither Thorndike’s nor Pavlov’s original 
formulation is entirely satisfactory, and having evolved a new and 
different conception of the learmng process, we also must now come 
to grips with the problem of unlearning within this new system 

Revised two-factor learmng theory assumes, as already indicated, 
that all learmng, in the final analysis, is sign learning or conditiomng — 


sponse decrement” (or inhibition) This ambiguity is unfortunate, but, for the 
moment, nothing can apparently be done about it The reader, to avoid confusion, 
only needs to bear in mind that when we speak of decremental or incremental 
reinforcement (or reinforcers) , the reference of the qualifying words is to the 
correlated dtrectton of change in the assumed underlying drive state and has nothing 
to do, necessarily, with either the augmentation or diminution of activity or be- 
havior, per se That is determmed by other considerations, notably whether the 
conditioned stimuli or signals in the situation are mdependent or response-dependent 
and on how and when the reinforcement is applied For example, by the sagacious 
use of reward it is possible to teach an ammal to “be still” as well as to “work ” 
and by the use of pumshment to be active as well as “inhibited ” The nature—that 
IS, the direction (up or down)— of reinforcement is thus, it seems, of greater 
systematic importance than is the question of whether the resulting behavior is 
mcremental or decremental ” ® 
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not conditioning in the sense of overt responses (or as mere “cogni- 
tions”) but in the sense of positive and negative emotions, notably 
those of hope and fear, which then mediate and guide actual behavior 
(but see also Chapters 2 and 5) And since extinction and counter- 
conditiomng are the recognized forms which unlearning takes where 
conditioned reactions are concerned, we here accept the assumption 
that these are the major (perhaps only) forms of unlearmng In the 
final analysis, extinction and counteiconditiomng may come down 
to the same thing, for a hope that is not confirmed is said to involve 
disappointment (which is a form of pumshment) and a fear that is not 
confirmed provides relief (which is a form of reward) Therefore, it 
may be more precise to say that unlearmng always involves counter- 
conditiomng, and that extinction is merely a species thereof But, for 
the moment, this is not a pressing issue 

What IS much more ciitical is the question of how one can accept a 
counterconditioning theory of unlearning and still be able to account 
for the manifest phenomenon of conflict As already noted, one of 
the serious weaknesses of Thorndike’s Law of Effect was that it had 
stimulus-response bonds being directly strengthened or weakened by 
reward and punishment, respectively, with no possibility of the subject 
ever expeiiencmg f lustration, confusion, or a sense of contradiction 
And if we now assume that unlearmng is simply a matter of the sign 
(“direction”) of signs being changed, from positive to negative (hope 
to fear) or the reverse, there might seem to be here also equally little 
grounds for the experience of conscious conflict A stimulus or situation 
would, presumably, be either “good, bad, or indifferent,” but nevei 
“ambivalent ” It would be strongly 01 mildly negative for the subject, 
strongly or mildly positive, or neutral, but it could not be positive and 
negative at the same time^ and this, at least superficially, is the essence 
of conflict 

Although this pioblem cannot be said to have been fully solved, a 
promising possibility lies in the fact that any one response or any one 
situation involves a great number and variety of stimuli, some of 
which may, at a particular point in time, be conditioned to hope and 
otheis to fear Thus, as the subject “attends” (Chapter 5) now to one, 
now to another set of stimuli, first one emotion (attitude) will pre- 
dominate, then anothei This could easily account for the back-and- 
forth vacillation sometimes seen in a conflicted organism and also 
explain why it is that such an organism is said to be of “two minds” 
about the situation (or action) in question Only when all or at least 
a clear majority of the stimuli associated with a particular response or 
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place become positive or negative does the individual become one- 
minded, unified, orgamzed (cf Mowrer, i960. Chapter XI) 

It seems, therefore, that the question of unlearmng offers no senous 
difficulties to revised two-factor theory and helps clarify the form 
which the theory, of necessity, must take — although this treatment of 
conflict needs to be carefully checked against N E Miller’s (1944, 
1958b) studies of approach-avoidance behavior It is beheved, how- 
ever, that Miller’s findings lend themselves rather mcely to reinter- 
pretation along the hnes suggested 

IX "Paradoxical" Resistance to Extinction 

In order to have the proper background for the section which is to 
follow. It IS necessary to say a word here about a paradox, sometimes 
known as the “Humphreys effect” (Skinner, 1938, Humphreys, 1939a, 
1939b) If a stimulus is followed by reward, it acquires the capacity 
to arouse hope, if followed by pumshment, the capacity to arouse fear, 
and if a stimulus which has been followed by either reward or pumsh- 
ment IS now followed by “nothing,” le, is not confirmed, it tends 
to lose the meamng it has previously possessed Such at least would 
seem to be reasonable assumptions 

However, some 20 years ago it was discovered that if, during train- 
ing, reinforcements occur intermittently, 1 e , if reinforced trials are 
interspersed with nonreinforced trials, then in the test situation there 
will be greater “resistance to extinction” than if reinforcement has 
occurred on each and every traimng trial For example, if a hungry 
rat learns to press a httle bar as a means of obtaimng food, this “habit” 
will be more persistent after food has been discontinued if, during the 
traimng peiiod, the subject has sometimes pressed the bar and received 
no food From a common-sense point of view, this outcome does not 
seem very remarkable persons, we observe, who have had a “hard 
time” are often more persevering, in the face of adversity, than are 
those who have had it easy ” But, in the hght of learmng-theory logic, 
the phenomenon has been puzzlmg 

On the assumption that hope (secondary reinforcement) is bmit up 
through the conjunction of a response (response-correlated stimulation) 
with reward and that hope is weakened by nonconfirmed occurrences 
of the response, then, for instance, 50 successive pairings of response 
and reward ought to produce more “habit strength” (hope) thL 50 
comparable rewarded occurrences of the response intermingled with. 
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say, 50 nonrew aided (extinction) occuriences theieof Consider the 
situation thus if each lew aided occuirence of the response produces 
a certain mciement of habit stiength and if each nonrewarded oc- 
currence produces a ceitain decienient, then any given number of 
successively rew aided occuii cnees of the 1 espouse should "‘add up” 
to moie habit stiength than the same numbei of lewarded occurrences 
inteimixcd with any numbei of nonrew aided occuirences That is 
to say, if each lew aided occimcnce of the lesponse is thought of as a 
(“plus’) and each nonicw aided occurience as a — (“minus”), then 
any given numbei ot -f’s alone will sum to 7 nore than will the same 
numbei of with — ’s (howevei few ) included 

Several diftcient conjectuies have been advanced to explain the 
Humphieys effect, of which the most satisfactoiy, until lecently, was 
the so-called “disci imination hypothesis” (Mowner & Jones, 1945, 
Bitterman, Feddeisen, & Tylci, 195^) It goes as follows When a sub- 
ject has been inteimittcntly leinfoiced during training, he continues 
to leact, at least foi a while, duiing the test peiiod as if “nothing 
has happened,” foi the leason that response without reward is no 
novelty to him That is to say he cannot, for a while, ‘‘tell the differ- 
ence” betw^een the conditions of intermittent reinfoi cement (wduch 
prevailed duiing tiainmg) and no reinfoi cement wiiatever (extinction), 
whereas if, duiing training, lewaid has been forthcoming on every 
trial, then the veiy fiist nonrewarded (extinction) trial is diffeient 
and the subject quickly senses that something is “wrong” and soon 
“stops woik ” 

Fiom a common-sense, intuitixc standpoint, this inteipietation seems 
very plausible, but its acceptance has been seen as something of a 
defeat foi icinfoi cement theoi\ in that the “disci imination hypothesis,” 
as ordinal ily foimulated, is highh “cognitive” and seems to tianscend 
ordinary leinfoi cement concepts (Woodwoith, 1958, p 265) But 
thanks to a lecent papci b\ Amscl ( i9'>8, sec also Section VIII), it now 
seems that the Skinnci-Humphrc\ s effect was “paradoxical” because 
the wdiole process of extinction (unlcaining) had been misconceived 
As Amsel has been able to show , on both logical and cmpincal giounds, 
nonreinfoi cement is not a purely neutral (meiely nonrcinforcmg) 
expeiience, it is, instead, a ftiibtration And what inteimittent lem- 
forcement duiing acquisition does, apparently, is not to pioduce a 
strongei habit (as inci cased lesistance to extinction has been taken to 
mean) but lather to make extinction {comistent noniewaid), when 
It finally comes, le^ts fnntjating — because the experience of nonrewaid 
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has previously been interspersed with leward and its “sting” removed 
In short, intermittent reinforcement seems to produce, not greater 
habit strength, but dnnmished pustration ejfectiveness 

Here, then, is an interpretation of the Humphreys eifect which is m 
no way paradoxical but is, instead, fully in accordance with expanded 
reinforcement principles They are expanded to the extent of assuming, 
not unreasonably surely, that the threat of punishment produces fear, 
that promise of a reward produces hope, and that a promise w^hich has 
been made but not fulfilled produces frustration or anger which, along 
with fear, can serve to obliterate (countercondition) hope And from 
this It follows that when, during so-called intermittent reinforcement, 
frustration (due to nonreward) on one trial is shortly follow^ed by 
reward on the next, then the reaction of frustration oi anger on 
the nonrewarded trials gives way to hope, which is all that is needed 
to provide the basis for a highly parsimonious and “objective” explana- 
tion of the Humphreys effect (There is an instructive complication 
here, which is raised by certain findings reported by Weinstock, 1954, 
but this, as w^e shall see in Chapter 5, merely stimulates our theory to 
healthy, new growth and in no way invalidates it ) 

Thus, the “discrimination hypothesis,” which has usually been 
formulated in frankly cognitive terms, can be reformulated m a more 
systematic way one which, to be sure, somewhat expands, but does 
not in the least impugn, our general “reinforcement” position 

X How Real is Secondary Reinforcement'^ 

The point has sometimes been made that a satisfactory theory of 
habit cannot be based upon the concept of secondary reinf 01 cement 
(see Section V) for the reason that the latter is so transitory and feeble 
Habits, as we know, can be extraordinarily stable and resistant to 
extinction, and if they are really dependent upon the secondary rein- 
forcement, or “hope,” that gets conditioned to the stimuli aroused bv 
the response in question, then secondary reinforcement must be capable 
of greater durability than most experiments have demonstrated In the 
laboratory this phenomenon has been typically studied as follows A 
buzzer is paired a number of times with the presentation of food to a 
hungry rat, and a bar is then made available to the rat, depression of 
which will cause the buzzer to sound but will produce no food Typi- 
cally, the rat will press the bar a few times (not many, but demonstrably 
more times than if the bar did not produce the buzzer), and then will 
stop Here the bar-pressing habit is established exclusively on the basis 
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of secondary reinforcement, but it is not much of a habit, as indicated 
by the comparatively few times it occurs Thus it has been argued 
that secondary reinforcement cannot be said to provide the basis for 
habits in general, which often are exceedingly strong and stable 
This objection is not well founded In the first place, the bar-pressing 
habit cited for illustrative purposes involves second-order conditioning 
which, as Pavlov showed, tends to be transitory and unstable That is to 
say, in this example the buzzer, as a result of its conjunction with food, 
acquires secondary-reinforcement properties, by first-order condi- 
tioning, and then the sensory feedback from the bar-pressing response, 
as a result of its conjunction with the buzzer, acquired secondary- 
reinforcement properties, but now, by second-order conditioning The 
response-correlated stimuli are therefore “once removed” from the 
primary reinforcement provided by food, and the conditioning, instead 
of being direct (as when bar pressing is immediately associated with 
food), IS indirect or mediated^ by means of the buzzer The fact that a 
habit which is established through second-order conditioning is weak 
IS certainly no grounds for assuming that a habit, established through 
jftm-ordei conditioning, cannot be strong and still dependent, as the 
theory assumes, upon secondary reinforcement 
Moreover, Zimmerman (1957, 1958a) has recently shown that even 
in the relatively unfavorable case of second-order (mediated) condi- 
tioning, a habit of surprising durability can be set up, if certain special 
conditions are observed As alieady noted, one can markedly increase 
resistance to extinction (or, rather, lower frustration effectiveness) if 
training involves intermittent reinf 01 cement, and since one of the 
great difficulties in setting up a new habit solely by means of a secondaiy 
reinforcer is the tendency of the latter, through extinction, to lose its 
potency, it becomes particularly desirable to use any expedient which 
will offset this tendency Accoidmgly, what Zimmerman did was to 
present a buzzer to a thirsty lat and then have it followed by watei, 
at first fairly regularly, but then less and less so, until finally an aveiage 
remforcement-nonremforcement ratio of about i-io was leached Un- 
der these conditions, when the buzzei sounded, the lat would still 
promptly “check” to see if water was going to appeal, but it became 
well accustomed to finding no water, following buzzei, although it 
could never be sure when watei might be present 
Hence, by the technique of intermittent reinf 01 cement, we may say 
that the buzzer acquired quite strong and persistent secondary rein- 
forcement propel ties This assumption was confirmed by the fact that 
when Zimmerman made it possible for the rat to produce the buzzer 
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(though never any water now) by pressing a bar, it did so a great many 
times, and this number, Zimmerman found, could be increased still 
further if bar pressing produced the buzzer, not on every trial, but only 
part of the time Thus, by means of what may be termed a double 
intermittent-reinforcement procedure, it has been found possible to set 
up an extremely stable and resistant habit, even though habit strength 
(secondary reinforcement) is acquired by the comparatively unfavor- 
able method of second-order conditiomng 

Altogether, then, it seems that the phenomenon of secondary rein- 
forcement, or hope, is real enough and quite strong enough to give to 
responses that degree of persistence and durabihty which “habits” 
typically have The revised two-factor interpretation of habit appears 
to be buttressed by sohd experimental data 

XI The Nature of Secondary Reinforcement 
More Precisely Identified 

At this point a source of confusion needs to be considered, namely, 
the fact that the term “secondary reinforcement” is commonly used 
to denote two phenomena which, at least superficially, are qmte 
different Because fear is generally regarded as a secondary (condition- 
able) drive and because it has been demonstrated, over and over again 
(Section III), that its termination (relief) has reinforcing power, many 
■writers (see, for example. Miller & Dollard, 1941) have referred to fear 
reduction, of the kind that occurs when a danger signal is terminated, 
as secondary reinforcement 

While this usage seems entirely legitimate, it is at variance with an- 
other usage which also has good precedent and justification As indi- 
cated in the preceding section (and in Section IV), Hull, following a 
hne of thought suggested by Pavlov, used the term “secondary rein- 
forcement” to denote the reinforcing power of a stimulus which has 
been associated with the termination of some primary or secondary 
dnve, such as hunger or fear Hull’s formal statement of this conception 
■was that “A receptor impulse [stimulus] will acquire the power of 
acting as a reinforcing agent if it occurs consistently and repeatedly 
within 20 seconds or so of a functionally potent reinfoicmg state of 
affairs, regardless of whether the latter is primary or secondary” (Hull, 
'943iP 95 ) 

Although the mechanism whereby this form of secondary reinforce- 
ment IS mediated was not made enarely clear by either Hull or his 
followers, it was supposedly related in some way to the notion of 
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anticipatory goal reaction which they commonly designated as Tg But 
the paradox which was involved here was that, basically, reinforcement 
was conceived of as involving drive reduction, yet secondary rein- 
forcement, as represented by the Xg notion, involves stimulation incre- 
ment, not decrement Gradually the conception of secondaiy rein- 
forcement has given way to a more explicit and more consistent w^ay 
of thinking about the pioblem, which can be summarized diagram- 
matically Fig 1-5 a shows the w^ell-known phenomenon of feai condi- 
tiomng Some originally neutial stimulus is converted into a “danger 
signal” by virtue of its being paired a few times with some painful, 
noxious stimulus such as electric shock which can be depended upon 
to elicit the emotional response of fear Undei these circumstances the 
subject soon starts “anticipating” the shock as soon as the danger signal 
appears and reacting with fear, as shown by the dashed line 


Signal 


Fear 



h d 

j m 




Shock 

hg l-5a 


Fig l~5b 


Figs l-5a and l-Sb Graphic representation of the operational (“situational,” see 
Hunt, Cole, & Reis, 1958) definition of four major emotions fear, relief, hope, 
and disappointment (f, r, h, and d, respectively) Fear and relief, on the one hand, 
and hope and disappointment on the other are, in some ways, just “mirror images” 
of each other, but they differ in another respect as well Fear and relief, although 
always having an implied reference to some primary noxious event (such as electric 
shock), may occur in the absence thereof, whereas hope and disappointment are, 
at least per theory, possible only when some such dri\e, or “problem,” is present 
This inference is supported by considerable empirical evidence (Mowrer, i960, 
Chapter 5) 

Now, once a conditioned feai leaction of this kind has been estab- 
lished (it can be objectively indexed by the psychogalvanic skin reac- 
tion), It can function as a seco? 7 dary drive, and if the subject does some- 
thing which causes the danger signal to “go off” (see dotted line) and 
prevents the shock from occurring, the secondary diive of fear will 
be reduced (see wavy line) and the subject will expeiience secondary 
reinforcement^ in the sense in which Miller & Dollard and others have 
used that expression This is the conception of secondary reinforcement 
(which can be conveniently designated as secondary reinforcement type- 
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i) which has proven so useful in explaining active avoidance learning 
and which gave rise to the new conception of punishment (passive 
avoidance learning) w hich has been described in Section III 

But vhat of that conception of secondary reinfoicement (which 
may be teimed secondary reinforcement type-2) which Hull has pre- 
sented^ Fortunately a cleai understanding of it, too, can be obtained 
by “extending” Fig i-fa as shown in Fig i-5b When the primaiy, 
noxious stimulus (shock) is finally terminated, its termination will be 
followed by a subsiding of the emotional upset or fear reaction And 
if a signal shortly precedes these events, it is reasonable to suppose 
that the fear reduction which follow^s shock termination will also soon 
become anticipatory, as suggested by the dashed line This effect, we 
conjecture, is what is ordinarily meant by hope and is the substance of 
what has become known, among psychologists, as secondary rein- 
forcement (type-2) Once established, it alone can pioduce higher- 
order conditioning (as Pavlov demonstrated) and can mediate habit 
formation without the occuirence of primary drive reduction (as 
Hull and many others have showm) 

This way of thinking has many advantages, prominently including 
the fact that it makes type-2 secondary reinforcement contingent upon 
secondary drive 1 eduction no less than is type-r secondary reinfoice- 
ment and that it provides an extremely satisfactory way of thinking 
about the phenomenon or disappointmetit or frustration The latter 
typically occurs when a “promise” is made but is not fulfilled — see the 
dashed line in the “safety signal” and the wavy line in the fear response 

Here then we have, in systematic relation to each other, the four 
major affects fear^ reliefs hope, and disappointment And earlier sec- 
tions have suggested the several roles which these “dynamic” factors 
play, in combination with the primary drives, in the instigation and 
control of behavior There are, to be sure, some questions concerning 
this schematization which have not as yet been fully answered (Mowrer, 
i960, Chapters 4-6), but the obstacles to its acceptance are now trivial 
in comparison to the advantages 

XII Unifying Power of the Present Theory 

One of the major aims of this (and the preceding) volume is to 
dehneate a psychology of learmng capable of reconciling and uniting 
nval hypotheses Two-factor learmng theory, in the revision that is 

considerable potency in this respect 
Confidence in its integraove possibihties is especially strengthened by 
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the fact that many other writers, quite independently, are moving 
toward much the same position 

In addition to its incorporation of some of the basic thinking of 
Pavlov and its explanation of many of the phenomena which par- 
ticulaily inteiested Thorndike, revised two-factor theory (another 
name would serve as \\ ell, or better) is compatible with many of the 
premises of “field theoiy” and psychoanalysis Here we may note 
especially the positive and negative “valences” which Lewin (1936) 
attributed to objects in psychological space and the positive and nega- 
tive “cathexes” of which Fieud (1920) often spoke A positive “va- 
lence” or “cathexis,” it seems, is simply that attribute (“hope” in our 
terms) which a stimulus acquiies by virtue of its conjunction with 
important satisfactions, and a negative valence 01 cathexis, by the 
same token, is simply that attribute (“fear”) which a stimulus acquires 


Response- 

correlated 

stimuli 


Independent 

stimuli 


Fig 1-6 Schematic representation of the symmetry 
and scope of two-factor learning theory 

by virtue of its conjunction with discomfoit or pain Revised two- 
factor theory likewise is congruent with common-sense (and social- 
psychological) notions about positive and negative “interests” and 
“attitudes” (Allport, 1935, Thorndike, 1935) 

The accompanying diagram shows the four categories of behavior 
which revised two-factory theory takes into systematic account Most 
of the behavior in which Claik Hull and his followers have been inter- 
ested in falls into categoiies I and, to some extent. III Thorndike was 
mainly interested in I and II On the other hand, Tolman, Lewin, and 
other “field theorists” have emphasized behavior falling into categories 
III and IV “Response” theorists and “place” theoiists have, it seems, 
engaged in quite unnecessary controversy in this connection Our pres- 
ent view suggests that both types of learning are valid and important. 
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and must both be included in any conceptual scheme which aspires to 
completeness 

Xlil Delayed Reinforcement, Generalization, 

Discrimination, and Skill 

In the scheme which is here under discussion, six forms of reinforce- 
ment have been identified (i) primary drive decrement, (2) pnmary 
dnve increment, (3) secondary drive decrement type-i (relief), (4) 
secondary drive decrement type-2 (hope), (5) secondaiy drive incre- 
ment type- 1 (fear), and (6) secondary drive increment type-2 (dis- 
appointment) Reinforcements (i), (3), and (4) are “positive” and 
reinforcements (2), (5), and (6) are “negative”, and each of these can 
function with either independent or response-produced types of stim- 
ulation, giving thus 12 “learmng situations” in all 

Now the picture takes on yet another dimension when it is realized 
that learmng occurs most readily when a stimulus and a reinforcing 
event occur in close “temporal proximity” but that learning is still 
possible when there is an intervemng interval of not to exceed 30 or 
40 seconds Following a suggestion made by Pavlov, Hull (1943) was 
able to derive the “gradient of reinforcement” from the phenomenon 
of stvntiilus tTctC6 (or immediate memory) It appears that every 
snmulus, however brief its objective duration, “lives on” for a time 
(“reverberates”) in the nervous system and that it is this fact which 
makes delayed reinforcement possible Reinforcement, strictly speak- 
ing, IS thus always here-and-now, never really “delayed”, and this 
contemporariness” is made possible by the phenomenon of stimulus 
trace 

There is now extensive research to document the foregoing assump- 
tions, but this has been reviewed earlier (Mowrer, i960. Chapter 10), 
and will not be further considered here And the fact that much longer 
intervals than those mentioned can be “spanned” by means of mediating 
stimuli will be discussed in the chapter immediately following the 
present one ° 

complicated and refined in yet another way 
When a living orgamsm learns to react (emotionally) to a parncular 
signal or conditioned stimulus, it has a tendency to react also to similar 
somuh (without specific expenence with them) according to a bell- 
s aped curve known as the (double) generalization gradient The 
biological economy in such an arrangement is obvious, but it also 
happens that such extension of learned reactions is sometimes not war- 
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ranted — ^it may, in fact, be decidedly maladaptive, and so living or- 
ganisms are capable of discnminati 07 i, which is a means of correcting 
generalization which has ‘‘gone too far ” 

In one sense, learning itself involves “generalization,” of what may 
be called the once-always variety Conditioning may be said to consist 
of an inductive process which, in verbal terms, goes as follows “Event 
A was followed by event B once, twice, , event A is always (oi 
at least frequently) followed by event B ” And when this form of 
learning has “gone too fai,” i e , is no longer functional, the phenomenon 
of extinction sets in as a coirective In like manner, what may be called 
one-many geneialization, while basically useful, must also be capable 
of correction when it is no longer so This is the role of discrimination 
Against the background of tins way of conceiving generalization and 
discrimination, one is in a position to think about the phenomenon of 
skill in an improved way The older “bond” conception of habit implied 
that a skill was just a well-practiced and somewhat over-learned habit 
If we now adopt the “feedback” conception of habit, which holds that 
behavior is “selected” and “guided” by the positive and negative emo- 
tions which have become conditioned to response-correlated stimuli, 
skill reduces to a matter of discrimination Evidence from many sources 
now suggests that the musical virtuoso, the athletic prodigy, or the 
“artist” in some othei type of behavior differs from the duffer mainly 
in being able to make very fine distinctions (discriminations) between 
the feedback from a peiformance that is exactly right and one that is 
only appioximately so They knov, m other words, more piecisely 
“what they are doing” This is not to say, of course, that theie are 
not congenitally determined factors that are essential to the attainment 
of unusual skill, but to these must always be added a highly tiained, 
highly “discriminating ear” or other means of sensing what is “going 
on ” Without this perceptiveness and sensitivity, if our theory is cor- 
rect, there can be no high aitistry or unusual “motor” accomplishment 
And from this same geneial orientation also comes a helpful sugges- 
tion concerning the nature of so-called response generalization As 
already noted, “oidmary” generalization is stimiilus generalization, in 
the sense that a response which has been conditioned to one stimulus 
is capable of being elicited (somewhat less vigorously) by similar 
stimuli By contiast, response generalization is said to involve the 
tendency for a stimulus or situation which has become capable of elicit- 
ing a given response to be capable also of eliciting a family of related 
or “similar” responses (Sometimes this phenomenon is known as “trans- 
fer of training” or, more simply, “transfer ”) If, now, it turns out that 
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the selection and control of behavior is dependent, not upon the 
stamping~in of S — R bonds in the Thorndikian sense, but upon the 
making of conditioned “connections” between response-correlated 
stimuh and certain emotions, then so-called response generalization be- 
comes, in the final analysis, merely a special case of stimulus generaliza- 
tion The full implications of this inference remain to be explored, but, 
from preliminary examination, they look very promising 

XIV. Tasks for Later Chapters— and for the Future 

Because the theory of learning which has been outlined in this chap- 
ter (and more fully developed in Learning Theory and Behavior) is, 
m many ways, unusually comprehensive and inclusive, it may at first 
seem odd that a second, elaborating volume is deemed necessary For 
some purposes, it is not But the very fact that this new approach n 
comprehensive and fraught with far-flung implications means (a) that 
It can be fruitfully extended into avenues where a less adequate theory 
would be “lost” and (b) that, inherent m it, there are also some diffi- 
culties which call for further consideration 

As already intimated in this chapter, there is now a growing body 
of fact and conjecture concermng mediating fimctions which could 
not be properly considered in the earlier book and which lead, very 
naturally, into the psychology of language Here, in turn, we find a 
limitation — but also a challenge — ^in that the phenomenon of meaning 
mamfestly involves learned reactions which transcend those thus far 
discussed and calls for a reconsideration of imagery And, over and 
beyond all this, is the fact that in abandoning the connectionist con- 
ception of habit, one is thrown back upon that ever-puzzling problem 
of consciousness The emerging science of cybernetics gives promise, 
however, of unusual assistance here and calls for careful attention 

Finally, if a more adequate conception of the total learning process 
thus emerges (largely from the study of animal behavior), it is natural 
to ask what its implications are for those distinctively human problems 
which are denoted by such terms as “personality,” “social learning,” 
and psychopathology ” Even at the end of this volume, many ques- 
tions will remain unanswered, and we shall see, in retrospect, that al- 
though we have come a long ways, the road is still opening before us 
inviting further inquiry ’ 




Latent Learning, Punishment, 
and Extinction 

and the Concept of Mediation 


With the concept of mediation we make the transition from “sim- 
ple” behavior to the more complex, “symbolic” processes But this 
concept is bioadly adumbrated in phenomena which are ordinarily 
thought of as stiictly “instrumental,” or nonsymbolic For example, 
in Chapter lo of the companion volume. Learning Theory and Be- 
havior, there is considerable leference to stimuli (both independent 
and response-produced) which serve to span or “bridge” temporal 
intervals which exceed the natural gradients of primary reinforcement 
and thus “mediate” learning which would otherwise not occur And 
in Chaptei 1 2 of the same volume, an explanation is given of so-called 
“response geneialization” in teims of ordinary stimulus generalization, 
and the latter, m turn, implies a primitive form of “mediation” (see 
also Postman, 1958) If a human subject, as a result of exposure to paiied 
presentations of a tone (of given pitch and intensity) and an electric 
shock, has been conditioned to respond to that tone with fear (as in- 
dexed by the galvanic skin lesponse), we expect him, as a matter of 
course, to show the same response (though not so strongly) to some- 
what different (higher and lower or louder and softer) tones The 
factor of “similarity” may be said to “mediate” or “carry” the sub- 
ject’s reaction from the original (specifically conditioned) tone to the 
other (not specifically conditioned) tones Here, in the instances cited, 
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IS a mechanism which, when elaborated, provides the basis for some 
remarkable behavioral and “intellectual” feats 
In this chapter we shall examine this mechamsm as it has been iden- 
tified and studied in the learmng laboratory 


I Early Studies of Latent Learning 


Few topics have a history as dramanc, and as tortuous, as that of 
“latent learmng ” The problem of selection and organization of mate- 
nal for a chapter on this subject which will do justice to the intricacies 
of fact and theory and at the same time not be unduly long is an acute 
one While it will thus not be feasible to review the history of this 
topic comprehensively, we can be thorough at least to the extent of 
beginmng at the beginning Then we shall soon discover that recent 
theoretical developments throw new light upon the old, established 
facts Here we find particularly convincing evidence for the notion 
that “habit” is a set of “valences” rather than a drive-response “bond” 
and that the concept of response (really “stimulus”) mediation is a 
powerful and versatile one 

The first systematic study of “latent learmng” was earned out at the 
University of California m 1929 by H C Blodgett, who was also the 
first to employ the term The objective of his study Blodgett stated 
thus 


The purpose of this mvestigatioii was to study the efficiency of units of 
practice when unaccompanied by rewards The method devised was that of 
running two groups of rats through the maze an experiptental g? oup which 
received no reward during the first part of learning, but which suddenly had 
reward mtroduced m the latter part of learnmg, and a control group which 
received reward throughout the whole of learning The answer to the 
question as to the efficiency of non-rewarded units of practice was sought 
m a comparison of the learnmg curve of the experimental group (both 
before and after the mtroduction of reward) with that of the control group 
(P 113) « ^ 


In referring to the literature which was relevant to his study, Blod- 
ptt found It necessary to cite only three previous investigations One 
by Simmons (1924) had only an indirect bearing and will not be de- 
senbed here but a study by Lashley (1918) and one by Szymansla 
(1918) are closely related to Blodgett’s work and are summarized by 
Blodgett as follows 


hcrh^l^nJ’ ^ expej^ent upon distribution of practice, throws some 

light upon our problem There were only 25 rats m ^ divided mto four 
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groups Group A was allowed to run about in the maze for 20 minutes the 
day before the first run During training, this group was given reward at 
the end of the run Group B was a control, run once a day with the incentive 
of food, Group C was run the same as A but was not allowed to correct 
errors, and Group D was lun with the incentive of food screened in the 
food box [cf the Watson and the Warden-Haas experiments, cited in 
Chapter 10 of Learnmg Theory and Behavior'] The quickest learning was 
made by Group A, the group which explored the maze tor 20 minutes before 
the first run The record of the control group. Group B, was next best, 
Group C was third, and Group D, last 

Szymanski has published a series of articles upon the learning of maze 
habits with various kinds of reward One of his experiments is closely re- 
lated to our problem Three rats were run through a maze to their home 
cage in which food had been placed The rats were not hungry At the end 
of 61 trials there was no reduction in time and error scores Then the condi- 
tion of experiment was changed so that the rats were run when they were 
hungry They ran the maze perfectly in one or two trials (p 114) 

The Blodgett study was divided into several parts, but the one of 
most immediate importance for us was carried out, in the maze shown 
in Fig 2-1, as follows 

Group I Co?2trol — This group consisted of 36 rats run once a day for 
seven days and allowed to eat for three minutes m the food box at the end of 
each run They were then removed to another cage (not the living-cage) 
and allowed to finish their day’s ration, after which they were returned to 
their living-cages 



Fig 2-1 Floor plan of maze used by Blodgett (1929, p 117) in study described in 
text Doors, indicated by the letter “D” and dotted line, were closed behind rat 
as it moved through the maze from Start to Food Box 
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Group II Expenme^ital — This group also consisted of 36 rats (They were 
litter mates of Group I ) For the first six days, Group II found no food 
in the food box and were kept in it without reward for two minutes They 
were then removed to another cage (not the living-cage) where they were 
fed after an inteival of appioximately one hour Only then were they re- 
turned to their living-cages For day seven and the two subsequent days 
they were treated exactly like Group I, that is, they found food in the food 
box for three minutes and finished their day’s ration immediately afterward 
in another cage 

Group III Experimental — This group consisted of 25 rats Like Group II, 
they began with no reward at the end of the maze But for them such reward 
was introduced at the end of the third day rather than at the end of the sev- 
enth day (pp 119--120) 



Fig 2-2 Results of Blodgett’s 
original study of latent learn- 
ing (1929, p r2o) The solid 
curve shows the rate of maze 
learning by a group of 36 hun- 
gry rats which received food 
reward on each day’s run 
Point X on the other two 
curves indicates the introduc- 
tion of food reward for the 
first time in comparable exper- 
imental groups The precipi- 
tous improvement in perform- 
ance thereafter is supposedly 
a reflection of prior learning 
which had remained “latent” 


The results, in terms of errors made in getting through the maze on 
the successive daily trials, aie shown in Fig 2—2 Here it is apparent 
that in both Group II and Group III there was a decided (and statis- 
tically significant) drop m errors on the trial immediately succeeding 
the first rewarded one (indicated by the letter “x”) 


Do these sudden drops in errors which come after the introduction of 
reward indicate that somethmg to be called latent learning developed during 
the non-reward period— latent learning which made itself manifest after the 
reward had been presented (p 122) 

After a stanstical analysis of his results, Blodgett concludes 

Taking these two results together, the hypothesis that the periods of non- 
reward m poups II and III really produced latent learning which became 
manifest when a reward was introduced seems well supported (pp 123-124) 
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At the time the original Blodgett study was carried out, little was 
known about the operation of secondary remforcers, either incremental 
or decremental Therefore, when Blodgett spoke of ‘'practice unac- 
companied by reward,” he meant, obviously, the 'primary reinforce- 
ment, or reward, provided by food and hunger reduction The ques- 
tion therefore arises as to the extent to which “latent learning” may be 
due, not to primal v reinforcement, which Blodgett excluded, but to 
subtle sources of secondary reinfoi cement 

In 1929--30, G W Haney (1932), also working at the University of 
California, repeated Blodgett’s expeiiment with a view to checking on 
the following possibility He said 

Blodgett removed his rats fiom the maze at the end of each run, hence 
there is the possible criticism that there may have been an element of re- 
ward even for the so-called non-rewarded rats in always going through the 
maze in the forward direction and in the fact of the mere removal from 
the maze and the leturn to the home cages at the end of each such forward 
run (p 320) 

In order to obviate this difficulty, Haney peiformed a different type 
of experiment, one lather similar to a part of the investigation by 
Lashley, previously referred to In it, on four successive days lats were 
allowed to wander about, without restriction, in a maze for a period 
of 18 hours They were then returned to the home cage but not fed 
for three hours, at the end of six hours, following return to the home 
cage, they were again put back into the maze Animals in a control 
group weie treated in the same way, except that their 18-hour periods 
of exploration were in “a simple rectangular maze ” 

When tested m what may be called the experimental maze, by being 
put into and released from the staitmg box, with food in the goal box, 
the animals which had become familial with this maze did significantly 
better, in teims of crioi scores, than did the contiol animals, which 
had exploied in the rectangular maze Haney concluded 

1 Under the conditions of this investigation, error differences between 
rats having previous general familiarity with the maze and those having none, 
seem to be real differences The critical ratio of 8 8 is indicative of a signifi- 
cant difference 

2 Under the same conditions the time score differences are not so sig- 
nificant (p 333) 

Since Haney’s findings aie in essential agreement with those of 
Blodgett (and Lashley), it seems clear that whatever secondary rein- 
forcement may have been derived by Blodgett’s experimental subjects 
by being lifted out of the maze following each day’s no-food run w^as 
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not responsible for the results obtained Indeed, the operation of sec- 
ondary reinforcement -v^ould not, in any case, account for ktem 
learning, since the effects of such reinforcement, whether decremental 
or incremental, would have been no less manifest during training than 
would performance changes brought about by primary reward or 
punishment Therefore, further analysis of this problem along these 
lines does not seem very promising 

It IS not surprising that the experiments just reviewed released a 
flood of new research In an article published by Thistlethwaite (1951) 
and entitled, “A Critical Review of Latent Learning and Related Experi- 
ments,” there is a bibliography of 76 titles, and the number of pertinent 
studies since published is probably equally great These studies make 
fascinating reading, but we cannot hope to review all of them, even in 
outline form Instead, we shall turn for the time being to studies of 
latent punishment and then revert, later, to latent learning in the posi- 
tive or decremental sense 

li Latent Punishment and the Mechanism of Mediation 

In 1933 Tolman published a highly readable and intriguing paper 
with the title, “Sign-Gestalt or Conditioned Reflex^” The reader can 
put himself in the proper mental “set” for appreciating this study by 
asking this question What would have happened, in the Blodgett in- 
vestigation, if on the seventh day the animals in Group II, instead of 
receiving reward (for the first time) as a result of running through the 
maze, had been placed (by the experimenter) in the goal box with 
food present? 

Says Tolman 

The general fact that specific acts tend to be learned or not learned ac- 
cording to the “goodness” or “badness” of their consequences is an empiri- 
cal generalization with which, I suppose, we would now all agree Our dis- 
putes will arise not with respect to this empirical fact but rather with regard 
to the hypothesis we would adopt for its underlying explanation The “trial 
and error” psychologists would explain this influence of consequences upon 
the learning by their laws of “effect ” They would say that those stimulus- 
response connections which are followed by “good” effects, whether these 
latter be conceived as pleasure, increased sensory consequences, or what not, 
will be strengthened, whereas those which are followed by “bad” effects will 
be weakened And they will hint at various neurological concepts to explain 
this back-action of effects upon learning But it is not this trial and error 
doctrine, in any of its forms, m which I am interested in this paper Rather 
I wish now to draw your attention to a conditioned response doctrine of 
consequences (p 246) 
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In a moment we shall leturn to Tolman’s discussion, but it is well 
to pause long enough to indicate why such extended quotation from 
this study IS desirable In the first place, we shall here again see (cf 
Mowier, 1960, Chapter 9) how closely Tolman has come to the con- 
ception of learning which undeilies our present appioach Here, in the 
paragiaphs uhich aie to follow, he lays the basis foi deriving tiial-and- 
error learning fiom conditioning and foi thus reducing all learning, in 
the final analysis, to conditioning — 01 what he preferred to call sign 
learning At the same time, he also advances some of the historically 
important logical consideiations out of ^\hlch the concept of response 
(stimulus) mediation eventually emeiged Tolman continues 

At first blush it might seem that the conditioned response psychologists 
could have no doctrine of consequences For in their original and pristine 
statement they seem to assert that a response gets learned (1 e , attached to a 
new stimulus) in so far as that new stimulus has been presented enough 
times preceding or just simultaneously with an original stimulus Good or 
bad consequences do not come into the picture It is the mere concatenation 
of the two stimuli which does the woik And yet the conditioned response 
psychologists, at least those in this country, do have a doctrine of conse- 
quences And one can but admit that they, in achieving it, have been both 
“as wise as serpents and as harmless as doves ” For they have invented a way 
of allowing for the different effects of good and bad consequences and yet 
at the same time of apparently still adhering to their original bom fide condi- 
tioning principles Let me illustrate in terms of a concrete experiment 

[Figure 2-3] shows the ground plan of a discrimination box similar to one 
w^hich I have been recently using B and W are black and white curtains 
hanging just behind the tw^o exits from the choice box They are inter- 
changeable The task is alwa\ s to choose the w^hite curtain D is a door which 
m each tiial is so placed that, if the animal chooses the white curtain he gets 
to the food, whereas, if he chooses the black he runs into a blind alley and 
also he can be given an electric shock in this blind alley How do our con- 
ditioned response friends explain such a discrimination learning^ 

They argue somewhat as follows Learning consists in conditioning a 
positive response to the white curtain and a negative response to the black 
curtain The rat learns to enter the door which, in the given trial, has the 
white curtain behind it because this w hite-curtained door, as a stimulus, is 
followed by a free open path and by food And to such free open path and 
food the positive responses of approach and of eating are already attached 
That IS, the unconditioned positive responses which the animal makes to 
the food or to the free open path get conditioned back to the stimulus, white- 
curtained door, which alwavs precedes them Similarly the rat learns not 
to enter the black-cui tamed dooi because this latter, as stimulus, is always 
followed by the fuithcr stimuli of blind end and electric grill to which latter 
negative responses arc already attached And these negative responses get 
conditioned back to the black curtain which just precedes them 

It appears that w hat oui conditioned i espouse friends really do is to divide 
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Fig 2-3 Floor plan of apparatus used by Tolman 
(1933, p 247) m testing deductions concerning “sign- 
gestalt expectations” 


all responses into two sorts — positive and negative And they argue that m a 
trial and error situation the acts which get learned are those which result in 
bringing the animal into the presence of further stimuli to which positive 
responses are already attached And the acts which do not get learned are 
those which result m bringing the animal mto the presence of further stimuli 
to which negame responses are already attached These resultant positive 
and negative responses get conditioned back to the cue stimuli It must be 
noted, however, that the positive and negative responses which thus get con- 
ditioned back may in concrete terms be as different from the original re- 
sponses from which they are supposed to be derived as entering is from eat- 
mg or as non-entering is from jumping back and squealing But this last is 
a little point which is not stressed by the theory Our conditioned response 
friends are truly both serpentish and dovelike (pp 248-249) 
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Again we interrupt the flow of Tolman’s argument in the interests 
of clarification Obviously the classical conception of conditioning, 
which Tolman is describing here, is much too simple to account ade- 
quately foi the observed facts As elsewheie indicated (Mowier, i960). 
It IS not overt behavioial 1 espouses themselves that get “conditioned” 
but rathei certain emotional (autonomic) reactions, notably those of 
hope and fear, w Inch then in turn goad, guide, and collect behavior so 
as to make it move along sensible and biologically useful lines This 
modification makes ample pi o vision foi the flexibility of behavior to 
which Tolman alludes, and it also provides a fullei and more explicit 
basis foi the “doctrine of consequences” which he is heie desciibmg 

But let us not be too captious For it must be admitted that this conditioned 
response formula, even though it be thus a bit — shall we say — Jesuitical, is 
really surprisingly workable It can be applied usefully to most discrimina- 
tion box and maze problems and, as such, it seems to provide a helpful 
schema for holding together past results and for predicting future ones 
Nevertheless mv purpose heie must be to show that there are (or at any 
rate there ought to be) tvpes of maze or discrimination box findings for which 
this all-useful though emasculated conditioned response formula will not 
hold 

By way of a first example, let me return to an experiment of m\ own 
which used a discrimination box like that just shown After having, as part 
of another problem, overtrained rats in this discrimination box, I tried 
putting them directly into the food compartments and shocking them then 
and there Then I carried them immediately around to S and started a run 
in the usual fashion M) assumption was that as a result of all their preceding 
training, m which they had been running through the box as the way to get 
food, the rats w^ould have built up what in my barbarous terminology I have 
called sign-gestalt expectations ^ These sign-gestalt expectations I assumed 
would be to the effect that the earlier parts of the discrimination apparatus 
w ould have become a sign or a set of signs to the rats that the encountering 
of the food compartments was to be achieved by running through this 
discrimination apparatus And, if the rats had built up such sign-gestalt ex- 
pectations, I assumed further that a single experience of the changed char- 
acter of the food compartments (01, as I should put it, this changed char- 
acter of the sigmficates of the sign-gestalts) should have been enough so that 
upon being reintroduced to the signs (that is, to the fiist parts of the dis- 
crimination box) the lats would at once have infeired or remembered this 
new changed character in the goal compartments And hence they should 
have refused to lun 

^This elaboration [sa^s Tolman] of the conditioned reflex formula is probably 
to be credited in the first instance to Smith and Guthrie (1921), to Wilson (1924) 
and to Frank (1923) See also Guthrie (1930) Recently it has been further elabo- 
rated in a series of striking ai tides by Hull (1929, 1930a, 1930b, 1931, 1932) Finally, 
for a criticism of it see Williams (1929) 
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But alas, no such thing Each rat (I must confess that I tried it with only 
four), after ha\ing been shocked in the food compartment and then carried 
to the starting point, immediately dashed off gailv and just as usual through 
the whole discrimination apparatus and bang whack into the very food 
compartment in which he has just been shocked If the rats had sign-gestalt 
e\pectations, then sign-gestalt expectations are not as intelligent as 1 ha\e 
supposed them to be (pp 69-72) 

In 1935, m a paper entitled “A Reply to ‘Sign-Gestalt 01 Conditioned 
Reflex^’ ” N E Miller leported positive findings in a situation similar to 
that outlined by Tolman, but suggested a diffeient y ay of interpieting 
them Miller began by saying 

In a very interesting and provocative paper, Professor Tolman has main- 
tained that, on the basis of sign-gestalt theory, “insightful” behavior ought to 
occur in a certain learning situation He has also expressed the opinion that, 
if this behavior actually does occur, it will be unexplainable in terms of 
conditioning ( p 280) 

Then, after briefly describing the Tolman expeiiment, Miller con- 
tinued 

The apparent stupidity of the rats might seem to be wholly in line v ith the 
principles of conditioning However, it is our opinion that such a view would 
be based on a misconception of the potentials of conditioned-response 
mechanisms It is true that the intelligent behavior expected by sign-gestalt 
would not Itself be a simple conditioned reaction But there is reason to be- 
lieve that It should be produced, as something new, by the interaction of 
several familiar principles of conditioning In fact, a conditioned-response 
analysis of the sign-gestalt experiment reveals a probable reason for the nega- 
tive results and leads one to predict that the insightful behavior should appear 
when the experiment is appropriately modified 

The discrimination apparatus, which happened to be a part of Professor 
Tolman’s set up, is not essential to the issue at stake So let us eliminate it and 
consider the case of the hungry animal running down a single alley for food 
The animal already possesses responses to joint stimulation from hunger 
and food Following Piofessor Hull’s (1931) terminology, we shall call these 
responses, such as eating, salivating and related behavior, the goal lesponses 
Since the goal responses, remforced by food, regularly take place immedi- 
ately following and during stimulation from cues in the food box, they 
should become conditioned to these cues 

But the reinforced goal responses also occur regularly a short interval after 
stimulation by the cues fiom the starting box and from the several portions 
of the alley Now, it is well known that if reinforcement regularly occurs a 
short interval after a given stimulus, a trace conditioned reaction to that 
stimulus tends to be set up and that there is a strong tendency for this trace 
conditioned reaction to antedate its reinforcement (Pavlov, 1927, Switzer, 
1934) Thus there should be a strong tendency for the goal responses to 
occur in the alley and in the startmg box 
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This theoretical expectation is given convincing empirical support by the 
well established fact that even reactions near the goal, such as the last turn 
leading to food, sho^v a strong tendency to intrude into the earlier portions 
of a maze sequence (Spence & Shipley, 1934, Spragg, 1934) However, it 
IS practicallv’’ impossible for the complete goal reaction to take place without 
the actual presence of food So one would expect only some parts of the goal 
reaction to take place in the starting box, the alley, and in the section of 
the end box preceding the food These might be such items of behavior as 
incipient mouth and head movements Let us follow Hull’s (1931) termi- 
nology again and call these antedating, fractional components of the goal 
response \v hich \\ ould occui in the starting box and the alley, anttetpatory 
goal re^po 7 nes 

Now, the principles of physiology lead us to expect these antedating re- 
sponses to produce a certain amount of characteristic interoceptive stimula- 
tion Thus, y hen the animal is placed directly into the food box and then 
shocked, the cues there will necessaiily be expected to arouse anticipatory 
(or complete) goal responses and the stimuli from these responses must pre- 
cede and coincide with the shock The responses to the shock will therefore 
be conditioned to these interoceptive [response-produced] stimuli 

When the hungry animal is placed in the starting box, the cues there will, 
as has been shown, lead to similar anticipatory goal responses These re- 
sponses will produce some of the interoceptive stimuli to which the reaction 
to shock have just been conditioned The animal should, accordingly, be 
expected to exhibit in the staiting box or the alley certain components of 
the withdrawing, crouching, sitting behavior which characterizes a rat’s 
conduct follow mg shock - Thus, w e hav e deduced from strict conditioned 
response principles that behavior related to the shock should appear in a situ- 
ation (the starting box and alley) which, to state it anthropomorphically, 
might on the basis of past experience be expected to lead to the shock even 
though this situation has never itself direct!} preceded the shock This type 
of transfer of training [note the term'] is commonly called foresight 

Let us restate our anahsis in brief, dogmatic form The laws of trace 
conditioning demand anticipatoi> goal responses The fact that the same rein- 
forcement follows both tlic food box and the alley requires that the an- 
ticipatorv^ goal icsponses to these two be at least partially identical The 
interoceptive stimulation fiom these similar anticipatory responses is the 
common element by v\ Inch the conditioning of the shock is transferred from 
the food box to the allev^ (pp 281-283) 

There is much food foi thought in the piecedmg paiagiaphs, so let 
us pause in oidci to anahzc and assimilate what is being said Fust of 
all, we see that Ahllci is pioposing a foimiila wdaich is applicable to a 
consideiablc langc of phenomena In the passages quoted, Miller him- 
self lefeis to imight and foicsight, but his hypothesis seems to apply 
equally to instances of behavioi wdiich aie termed “latent learning” 

“Here Miller, too, is cxpositing the classical conception of conditioning We 
would now sav^ that it is fear which is conditioned in this situation and that it 
then 7 ?iotivates o\crt acts of the kind described 
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and “reasoning” (see Chapter 6) And the key concept is what has since 
been termed response mediation As Miller suggests, “transfer” of learn- 
ing from one situation to another quite different situation can be ex- 
pected to occur if some item of behavior, implicit or overt, is cormnon 
to both Actually, of course, it is not the communality of behavior, as 
such, in the two situations that provides the basis of transfer of train- 
ing but, as Miller shows, the connminality of stmndation which the 
occurrence of the same or similar behavior in the two situations pro- 
duces Hence it is more accurate to speak, not of response mediation, 
but of stimulus mediation, or, more exactly still, of response-produced- 
stimulus mediation (That this is inherently the same logic as employed 
by Miller is indicated by his use of such terms as “transfer,” “partially 
identical” responses, and “common elements ” Note also his reference 
to “interoceptive stimulation ”) 

This way of thinking can be made more readily comprehensible, per- 
haps, by the following analogy Suppose that a rat has been trained to 
find food at the end of a black L-maze Suppose also that the goal 
box of the maze (not visible from the starting point) is painted white 
But now suppose that the rat, after the training just described but 
while satiated, is placed in the white goal box, with a barrier to prevent 
escape, and given one or more electric shocks Later, after the rat has 
been removed from the maze and allowed to get hungry, it is put back 
into the maze, at the usual starting point But now, as the rat looks down 
the first leg of the maze, suppose that, instead of seeing the uniform 
black interior, it sees, on the wall, immediately back of the turning 
point, a large patch of white It v/ould be in no way surprising, cer- 
tainly, if the rat, though hungry, would show conflict in the first leg 
of the maze or perhaps completely refuse to leave the starting area 
Here one of the stimuli which had been associated with the electiic 
shock has “moved forward” in the maze and effectively inhibits the rat 
with respect to a type of behavior (running the maze) for which it 
has 7iever been pimished The white area seen down the alley, at the 
turn, “reminds” the rat of the shock received in the goal box and 
immobilizes it Or, to be more precise, the fear conditioned to the xv hite 
end compartment in which shock Vras experienced generalizes to the 
white area, near the turn, and produces anticipatory or “foresightful” 
inhibition 

Such foresight” (in the quite literal sense’) is manifestly an instance 
of stimulus mediation If, on the other hand, the interior of the maze 
is left completely unchanged (i e , all black) following shock in white 
goal box, the animal may still, as suggested by Miller, show foresight 
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But now the inhibition of behavioi must be produced by fear which 
IS conditioned, not to some external stimulus, but to some response- 
pi oduced stimulus or stimulus pattern Hence one would expect that, 
under these conditions, the rat would have to be hungry and to have 
made some of the ‘'goal lesponses” just as the shock was applied, so that 
they, when later occuriing in the staitmg box or maze, would produce 
stimulation to which feai had been conditioned and would thus arouse 
fear and inhibit behavioi which, in the ordinary sense of the term, had 
never itself been punished 

Thus we aiiive at one of the major unifications of field (sign- 
gestalt) theoiy and stimulus-response (conditioning) theory Tolman 
was eminently light in predicting the phenomenon, but Miller, as a 
repiesentative of the stimulus-i espouse school, gave the first fully 
explicit rationale for such behavior Tolman, it will be recalled, in the 
paper cited speaks at some length about the wide applicability of con- 
ditioning principles but holds them to be incapable of explaining be- 
havior of the kind desciibed Aiillei’s analysis quite straightforwardly 
deduces the phenomenon fiom conditioning principles, though in m- 
tioducing the concept of anticipatoiy (mediating) lesponses and the 
concept of fear one is going somewhat beyond the type of conditioning 
theoiy which was prevalent when Tolman wrote his paper and Millet 
replied to it 

'‘Mediated (foresightful) beha\ior of the kinds just described would, if real 
(see Sections III-V), ha\e such obMous biological \alue that it has apparently 
not occurred to anyone pre\iously to ask if they might ever be maladaptive But 
a student, Mr Jeirv Griffith, upon reading the galley proof of this chapter, has 
asked this question The answer seems to be that, although very generally useful, 
such behavior lan be useless, nonfunctional, misleading Let us revert, for the 
sake of simplicity, to the hypothetical L-maze expeiiment, in which the mediating 
stimulus is proMded b\ the environment, rather than being response-produced 
Although a pitch of white at the turn, which is visible from the starting point, 
would almost certainK tend to opei itc, ps\ chologically, in the manner suggested, 
there is no inherent reason w hy the appearance of such a patch would necessarily 
indicate that shock would now again be cvpciienced in the goal box Its presence 
might mean, quite specifically, tint goal-box shock would not occur Therefore, 
if the subject, on the basis of stimulus geneialization, reacted to the patch as to 
the whiteness of the goil box itself, such a leiction would, under these conditions, 
be quite “wrong’ But this rather special example does not in the least impugn 
the supposition tint response (stimulus) medntion is, in general, highly ad- 
vantageous and helpful \\ hat it does show is that, in some situations, response- 
mediated generihzation Ins to be corrected by further (discriminative) learning 
(see Movvrer, i960, Chaptci 12) Cf the subsequent discussion in this chapter of 
response-mediated disciimiintion, also, in Chapter 6, the idea of wrong “insights” 
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III A Theoretical Deduction Empirically Confirmed 

Now that Miller has given us such an excellent theory of “latent 
learning” (incremental type) and related phenomena, it might be nice 
to know if it is so Fortunately, m the same papei Miller also reports 
confirmatory data We return to Miller’s account of his woik 

But the sign-gestalt [Tolman’s] rats did not exhibit the foresightful be- 
havior demanded by the conditioned response analysis How can this be 
accounted for^ It will be remembered that the foresightful behavior was 
deduced from the assumption that a distinctive response, affording a chai- 
acteristic pattern of interoceptive stimulation, was present in the food box If 
this response w as absent during the original training to run the alle\ , com- 
ponents of It could not become anticipatory If this response was absent or 
only weakly functional when the animals were placed directly into the food 
box and shocked, the reactions to the shock could not become conditioned 
to any characteristic pattern of interoceptive stimulation In either case the 
insightful behavior would not manifest itself If, on the other hand, an ex- 
periment should be arranged in which the distinctive response affording the 
crucial interoceptive stimulation was sure to be present in gross form, the 
insightful behavior should appear 



Fig 2-4 End boxes employed by Miller (1935^?, p 284) requiring subject to make 
distinctive responses just before and as reward was obtained 

To test this logic, several experiments were set up in which the reward 
devices illustrated [in Fig 2—4] forced the animals to make very gross and 
distinctive responses in order to secure the lure after entering the end box 
of the alley In one reward device the animal was forced to climb up and 
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make a sharp turn to the right to secure food, m the other he must go straight 
in and make a sharp turn to the left to secure water 
In the first experiment seven animals, motivated by both hunger and 
thirst, were trained to run down a short alley at the end of which they found 
only the special reward device containing food At other intervals during 
this preliminary learning these animals were placed in a special cage, isolated 
from the alley, and given separate training to use both the food and the water 
reward devices there, one at a time 

Then three of the seven animals were put through the following pro- 
cedure The rat w^as placed in the special isolated cage which contained onl\ 
the food in its reward device As soon as he had climbed up, turned to the 
right in the accustomed manner and taken his first bite of food, he was 
shocked for one second Then he w^as given time to get off the grid and 
was kept in this special cage for a two-minute period during which he was 
given an additional immediate shock each time he touched the grid At the 
end of this period he was taken out and placed in another cage for three 
minutes in order to allow the general disturbance from the shock to 
subside somew^hat After this, he w as placed in the starting box of the alley 
The length of time it took him to reach the last curtain [there were four 
curtains in the alley, the last just before entry into the food box] was re- 
corded The reward device was now absent from the box at the end of the 
alley Thus, the animal could be put back into the starting box and given a 
total of five test runs w ithout danger of secondary conditioning 
The other four rats w ere put through a similar procedure except that they 
were shocked in the isolated special cage while using the water reward device 
The experimental results confiimed the deduction from the conditioned 
response theory The animals that had been shocked in the isolated food 
device while performing the act identical with the one ordinarily following 
their alley behavior sequences, required longer on the average for their first 
test run through the allev^ than those that had been shocked in the water- 
reward device while performing the act not associated with the alley (pp 
283-286) 

There is moie to the Millci study, including other experimental 
lesults and statistical analysis of then leliability, but the gist of his 
argument and findings has been given His papei ends 

In conclusion^ the icsults of the first two experiments demonstrate that 
there is generalization of conditioning (in other words, a transfer of train- 
ing) from the lewaid device to the alley, wdiich is dependent upon the 
previous association betw^een the two A comparison of these results with the 
negative results of the sign-gestalt experiment (Tolman, 1933) suggests that 
the distinctiveness of the goal (or near goal) reaction is an important factor 
in determining the amount of the transfer The third experiment suggests 
that the results of the first two would have been still more striking if the 
reactions in the tw o reward devices had been more dissimilar 
In the situation used in these experiments, the generalization of condi- 
tioning, dependent upon previous association is commonly called foresight 
A deduction of this foiesightful behavior has been made from strict 
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conditioned-response principles This conditioned-response analysis may be 
said to ha\e reduced the concepts used m the sign-gestalt description of 
foresightful behavior to more basic ones which are amenable to direct in- 
vestigation and which already have been found useful in the description of 
hosts of other, quite different situations The theoretical analysis using these 
stimulus-response concepts tends to be confirmed by the fact that it sug- 
gested the modification which produced the positive experimental results 
(pp 290-292) (see also Miller, 1951b, pp 464-466) 

Several years later, Tolman & Gleitman (1949b) published a paper 
entitled “Equal Reinforcements in Both End-Boxes, Followed by Shock 
in One End-Box,” which was in certain important respects a replication 
of the Miller study — and which also produced positive results Tolman 
& Gleitman summaiize their study by saying 

I Twenty-five hungry pigmented M and M Try on stock rats were run 
in a covered T maze [see Fig 2-5] to equal food reinforcements at the two 
ends of the T The two end-sections were strongly differentiated The end- 
boxes were of different size and one had a bright light shining into it and 
the other was dark The two entrance sections to these end-boxes also dif- 
fered One had baffles and the other a hurdle, and the doors into the end- 
boxes were somewhat different in size and manner of being hinged 



Fig 2--5 Floorplan of special T-maze employed in study of latent punishment 
pubhshed by Tolman & Gleitman (1949b) As will be apparent from the drawing, 
the end boxes and the entries thereto were different for the two wings of the maze 
The point of these differences was to provide the subjects (rats) with distinctive 
impressions of the two wings which might mediate foresightful behavior at the 
choice point (see text) 
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2 After equal training on the two sides — one free trial and one forced 
trial per day for nine days — ^the two end-sections were placed in another 
room Half of the rats were shocked in one of the end-boxes and half in the 
other 

3 When placed back on the maze, 22 out of a total of 25 rats immediately 
avoided the side leading to the box in which they had just been shocked 
In this test trial all animals were run undei equal dri\e strength — 1 e , 26 hours 
of food deprivation 

4 In the original training the total group had been di\ided into two 
motivation groups — one 48 hours hungry when originally trained in the 
maze and the other 12 hours hungry No differences in the later avoidance 
of the side leading to the box in which the animals had been shocked ap- 
peared between the two motivation groups 

5 Our general theoretical position is that, although the Spence and Lip- 
pitt (1946), Kendler (1947), Kendler & Mencher (1948), and Walker (1948) 
experiments have indicated that “latent learning” under the conditions of their 
experiments did not appear, this does not disprove the possibility of latent 
learning appearing under other conditions All that the sign-Gestalt (or field 
expectancy) theory of learning assumes is that under some conditions, latent 
learning — that is leammg which does not involve the differential reinforce- 
ment of responses — can nevertheless take place 

6 The present experiment now seems to have clearly provided such a set 
of conditions 

7 It is suggested that many further experiments varying such factors as 
the type of maze set-up, the amounts of initial training, degrees of motiva- 
tion, forced or non-forced trials, the presence or absence of a reward object 
for the drive under which the animals are initially trained, and the like are 
needed in order to discover the precise conditions under which a non-differ- 
entially rewarded picking up of discrimmanda and discriminanda relation- 
ships (le, latent learning) will or will not tend to appear (pp 818-819, 
Italics added) 

iV Seward^s Study of Latent Learning 

At this point It may be useful to pause and ask Just what is implied 
when one speaks of “latent learning”^ Several diffeient kinds of 
“mazes,” including a discrimination apparatus, were employed in the 
studies thus far cited in this chapter, and the common element in all 
the types of lesulting behavior may not be immediately evident Tol- 
man & Gleitman, in the passage just quoted, give a definition of latent 
learning when they say “latent learning — that is the learning which 
does not involve the diflFerential reinforcement of responses ” In the 
decremental, or reward, sense of reinforcement, the right- and left- 
turning tendencies of the Tolman-Gleitman subjects weie not “differ- 
entially reinforced” m that, during the preliminaiy training, both nght- 
and left-going tendencies were lemfoiced equally But what about the 
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incremental reinforcement, or punishment, employed in the experiment^ 
Was It also applied with equal impartiality^ It is true that no animal 
was ever subjected to shock after having just gone from the starting 
box in the T-maze to eithei the right end box oi the left end box 
Therefore, strictly speaking, one must again say that these responses 
were not “differentially reinforced” But this does not exclude the 
possible — ^indeed, the very probable — opeiation of the type of mech- 
anism postulated, and apparently demonstrated, by Miller Of this 
possibility, Tolman & Gleitman say 


It IS to be recalled that some years ago Miller (1935a) performed an 
experiment which had features similar to ours, the results of which he ex- 
plained in reinforcement terms plus the assumption of anticipatory goal- 
responses 

An especial feature of Miller’s argument is that the two very distinctive 
goal-responses made by the ammals in the two end-boxes produce two very 
distinctive anticipatory goal-responses with two very different resultant 
proprioceptive stimuli One of these sets of proprioceptive stimuli gets con- 
ditioned m the shock situation to avoidance [fear] and the other does not 
Now it must be admitted that our own experiment involved a somewhat 
similar set-up [Therefore] we cannot altogether deny the possibility 
of such an explanation Absolutely to settle the issue it would be necessary to 
repeat our experiment where the two end-boxes differ in “perceptual” char- 
acters only and where absolutely no differences m goal response m the two 
boxes would be involved However, it may be noted in Seward’s experiment 
(1947a) It was found that white and black goal boxes, when the rats were 
fed in one and not in the other, gave as positive latent learning results as did 
a pair of goal boxes which did produce different types of overt responses 
However, it may be asked what about blinking, pupillary reactions or the 
like^ Is It possible to have a perceptual “awareness” of any sort without 
concomitant motor responses^ If it is Miller’s (or Seward’s) argument that 
there are such differentiating motor accompaniment for all perceptual proc- 
esses, then these authors can perhaps hold, if they want to, that what we 
nave called sign-Gestalten are based upon chains of minimal anticipatorv 
responses going on at a very covert level We, personally, are interested 
in the functional significance of latent learning and the resultant functional 
concept of sign-Gestalten and not m extremely hypothetical notions concern- 
ing the underlying neurology (pp 817-818) ^ 

‘It may not be immediately evident to the reader what it is that Tolman ob- 

1 ° “ Manifestly it apphed neatly to the experiment 

which he and Gleitman have here reported From a general knowledge of Tol- 
man s systemanc thmkmg we may, however, infer that he was privately convinced 
behavior can occur without any form of stmmlus mediation 
(whether independent or response-produced), can occur, at least under optimal 

rf Cha™; and 5' cogmnons (memories, images, “knowledge”)- 
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It may seem that the experiments of Tolman, Miller, and Tolman 
& Gleitman, just reviewed, have departed considerably from the in- 
vestigation by Blodgett previously described in this chapter These 
experiments have departed, perhaps most indisputably, m that they 
have all involved punishment, whereas the Blodgett study did not But 
these investigations have been selected for special consideration be- 
cause they, probably bettei than any others, show the development 
and explanatory power of the concept of response mediation or, more 
accurately, response-prodiiced-stiwiilation mediation With the media- 
tion, or transfer, notion now well in mind, let us turn from experiments 
on what might be called “latent punishment” to further consideration, 
in the same general frame of reference, of latent learmng where the 
mam result is produced, not by incremental reinforcement, but by 
decremental reinforcement or reward Here a study published by 
Seward (1949) and entitled, “An Experimental Analysis of Latent 
Learning,” comes conveniently to hand The author begins 

How does a rat learn a maze^ According to reinforcement theory (Hull, 
1943), when a rat chooses the correct path his responses lead more directly 
to food and thus receive a greater share of primary or secondary reinforce- 
ment than when he enters a blind alley In later trials he reacts on the basis 
of differential strengths of habit thus produced According to sign-Gestalt 
theory (Tolman, 1932) a rat learns a maze by running it, he then chooses on 
the basis of anticipated consequences If hungry he takes the path that leads, 
in his experience, to a food place To decide between these views we must 
separate running the maze from feeding in it, learning should then be re- 
tarded by the first view but not by the second The latent-learning experi- 
ment IS thus a crucial one In it the rat first explores an empty maze, he 
then finds food at some point in it, whereupon he has been found to run 
the maze as well as if fed there from the begmnmg (Blodgett, 1929, Tol- 
man & Honzik, 1930) 

Elsewhere I have tried to envisage the essential mechanism of maze learn- 
ing as revealed by the latent learning experiment (Seward, 1947b) It involves 
two stages (i) the rat builds up differential anticipatory responses to the 
right and left cues at the choice point, (2) one of these responses becomes 
associated with food As a result the rat now reacts to the appropriate cue 
because response to it is “reinforced” (1 e , facilitated) by food anticipation 
[or, in terms of the thinking evolved in Learmng Theory and Behavior^ 
secondary reinforcement, in the sense of hunger-fear reduction] To test this 
interpretation let us suppose that a rat is allowed to explore a simple T-maze 
with all outside cues removed and with endboxes clearly differentiated but 
out of sight from the choice point He is then put directly into one of the 
endboxes, where he finds and eats food for the first time After this experi- 
ence he IS placed in the starting box and allowed to choose either arm of the 
maze The above interpretation leads us to predict that the rat will go 
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directly to the bo\ in which he has been fed There is one important proviso 
the endboxes must be distinguished in such a way as to arouse different re- 
sponses which can be partially reinstated at the choice point on the critical 
trial Otherv^ise the rat will be left with no medium to serve as a connection 
between choice-point cues and anticipated food (p 177) 

Before reviewing Seward’s empirical findings, it is well to remark 
briefly upon certain features, expressed and implied, of the foregoing 
paragraphs It is apparent, first of all, that Seward’s conception of latent 
learning follows along lines very similar to those laid down by Millei 
m his 1935 paper The “different responses” stressed by Seward clearly 
serve as mediators for the transfer of learning from one part of the 
maze (the goal box) to another (the choice point) Seward does not 
speak explicitly of response mediation (nor does Miller, for that 
matter) , but his intention is clear and he comes very close to the term 
Itself in saying that without these “different responses,” the rat “will 
be left with no medium to serve as a connection between choice-point 
cues and anticipated food ” 

One other point should also be considered As already noted in 
connection with the problem of latent punishment, it would be in no 
way surprising if, after being shocked in a white goal box, a rat avoided 
going to that box if an area of white could be seen from the choice 
point, indeed, the rat might even refuse to go to the choice point, if 
an area of white could be seen just beyond it (cf Section II) Let us 
now apply this type of stimulus mediation (or generalization) to latent 
learning, rather than to latent punishment In the type of situation de- 
scribed by Seward, the procedure might consist of first letting the 
subjects freely explore a T-maze, as proposed, then feeding the rats 
(individually) in one of the goal boxes, which is painted v^hite Later, 
if a patch of white were placed near the white goal box and in such a 
position that it could be seen from the choice point, it would not be at 
all surprising if the rats made a high percentage of “correct” choices 
on the first trial, le, with no “practice” (see Mowrer, i960. Chapter 
10, Section X) The correct performance would be stimulus-mediated, 
but this IS not to say that it occurred without “differential reinforce- 
ment” It is true, of course, that no particular respome has been “dif- 
ferentially reinforced”, but a ^timilus has been— and this, it seems, is all 
that IS necessary to produce “latent learning ” Thus, the negative defini- 
tion of latent learning, given by Tolman & Gleitman, as “learning which 
does not involve the differential reinforcement of responses” needs 
to be supplemented by a positive statement This might take the fol- 
lowing form latent learmng occurs (and will later be manifested^) 
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when some stimulus which will later be produced by a given response 
IS first produced independently and conditioned to either hope or 
fear, such a stimulus being properly known as a mediator 

V Latent Learning Analyzed Further 

Now this type of thinking, suggested by Seward’s experiment and 
by earlier discussion in this chapter, may have an interesting bearing 
upon the findings leported by Blodgett In his experiment there was, 
to be sure, only one goal box, but there were many blind alleys Sup- 
pose, then, that on the seventh day of experimentation, instead of being 
allowed to nin through the maze into the alley containing the goal 
box and there, for the first time, finding food, the rat had, on this day, 
been passively cairied to and placed in the now baited goal box Sup- 
pose that, in addition, as the rat ate it “noticed” (see Chapter 5) certain 
features of the experimental loom which could be seen directly above 
the goal box On the basis of familiar and well-established principles, 
we would expect these visual stimuh to take on some degree of sec- 
ondary reinforcement What, then, would be the most likely result 
when, next day, the rat was allowed to run the maze^ If some of the 
extra-maze stimuli which had been seen and thus secondarily rein- 
forced while the rat ate in the goal box could now be seen from other 

the foregoing sentence is not entirely clear to the reader, let him take 
comfort on rereading it, in galley proof, the writer is not certain he knows ex- 
actly what It means, either Perhaps these additional comments will help First 
of all, let It be observed that in all forms of mediated learned behavior, what 
happens is this the mediating stimulus (either response-produced or independent) 
occurs in a “new” situation and makes it sufficiently similar to, or reminiscent of, 
an “old” situation that there will be a generalization, or transfer, of learning from 
the old situation to the new one In other words, the mediator makes the new 
situation enough like the old situation that it produces the same or at least a 
somewhat similar type of behavior Here, presumably, is the essential and common 
feature of latent learning (and punishment), foresight, sensory preconditioning 
(Section VI), and insight (see Chapter 6) This position will be given further 
support in the section which follows But one thing more needs to be said here 
In experiments of the kinds presently under discussion, the “new situation” is 
usually one that is physically (often spatially) different from the original one 
for example, the difference between the goal box and the starting box or alleys 
of a maze The difference might, however, be entirely internal e g , a change in 
drive state or in the neural trace from prior stimulation (see Mowrer, i960. Chapters 
10 and 12) But this qualification does not, it seems, alter the basic principles which 
have been postulated, although it may be that there are aspects of the problem 
which have not yet been thoroughly analyzed and that a more felicitous termi- 
nology could be developed for the whole area 
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pel? ts of the WG miglit reasonably expect the rat s maze responses 
to be differentially satisfying, depending upon whether they carried 
the rat toward or away from these “cues,” or secondary remforcers 

If this were the way “latent learning” operated in the Blodgett ex- 
periment, It would not be a case of the maze being learned at all, not 
even “latently,” during the trials which were not food-rewarded, but 
rather simply a case of the rat, after one experience of eating in the 
goal box, being guided through the maze, on the next trial, by extra- 
maze cues which had thus taken on secondary-reinforcing, or goal- 
attraction, properties 

This type of reasoning is purely hypothetical as far as the Blodgett 
experiment is concerned, since no reference to extia-maze cues is made 
in the report thereof ^ But in the Seward experiment, already alluded 
to, such cues were studied and found to be effective, along with 
response-produced stimuli, in mediating the occurrence of perform- 
ances which had never been directly reinforced Says Sewaid, by way 
of summarizing his investigation 

An experiment was devised to test a hypothesis about the essential require- 
ments for latent learning at a choice point The hypothesis was that these 
consist of two separable factors (i) associations between choice-point 
stimuli and alternative consequences of going right or left, giving rise to 
differential anticipatory reactions at the choice point, (2) association be- 
tween one of these consequences and a satisfier To test this hvpothesis extra- 
maze cues were largely [but not entirely’] excluded from a simple alley 
T-maze Rats were allowed to explore without food, they were then [placed 
and] fed in one endbox and immediately thereafter given a free choice in 
the maze Twenty-eight out of 32 rats, or 87 5 percent, chose the path to 
the endbox in which they had been fed 

Three control experiments were run in an attempt to delimit more pre- 
cisely the factors involved in this performance 

1 A control group prefed and tested without previous experience in the 
maze failed to exceed chance 

2 To isolate the critical cues operating on the test trial, all differences 
between the right and left endboxes were eliminated for one control group, 
all cues outside the endboxes were removed for a second group In neither 
case did the scoie exceed chance These results indicated that successful per- 
formance depended in part on differential anticipatory reactions to end- 
box cues 

3 The main experiment was repeated with fresh rats, but they were 
placed in both endboxes, one with and one without food, just before their 
free choice Twenty-six of 32 rats, or 81 4 percent, chose correctly, thus 
establishing the role of the food incentive (p 185) 

®For an experiment bearing upon related but not precisely the same considera- 
tions, see Meehl & MacCorquodale (1953), also Desiderate (1956) and Honzik & 
Tolman (1936) 
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The most important sentences in the above quotation are these “To 
isolate the critical cues opeiatmg on the test tiial, all differences between 
the right and left endboxes weie eliminated from the control group, 
all cues outside the endboxes weie lemoved foi a second group In 
neithei case did the scoies exceed chance” Elsewhere (Mowrer, i960, 
Chapter 9) we have levieved the contioversy as to whether place 
learmng 01 1 espouse learning is the moie basic and have concluded 
that the question is not meaningful — 01 at least of no theoietical im- 
poitance Adaptive bchavioi, as we have lepeatedly seen, can occur 
on the basis of cithei placc-pioduced or response-pioduced stimuli or 
on the basis of both Thciefoie, it v ould seem reasonable that mediating 
stimuli can likewise be cithei place-pioduced or response-produced In 
the expel iments on latent punishment leported by Miller and by Tol- 
man k. Gleitman, the mediating stimuli weie obviously response- 
pioduced, whcieas, in the expeiiments on latent learning of the more 
“positive” kind, lepoitcd by Blodgett and by Sew^aid, the indications 
are that the mediating stimuli (01 at least some of them) were place- 
produced 

Heie again thcic is no theoietical issue If either a punishment or a 
reward is expciicnccd in conjunction with stimuli that aie provided 
eithei by the enviionmcnt 01 by the subject’s owm behavior, and if these 
same stimuli aie then expciicnccd (peiceived) at a distance from the 
point wheic the icinfoi cement occuried, the subject will have a 
tendency to avoid 01 to appioach the place of leinforcement, without 
having evci been pic\iousl\ punished 01 lew^aided foi doing so This, 
It seems, is the essence of so-callcd “latent” learning (be it inhibitory 
or facilitoi v) and of “foicsight ” This conclusion is in accord with the 
point of view aiiivcd at m Chaptci 7 of Learning Theory and Behavior 
in connection with the discussion of w^hat w^as there termed learning 
without doing l.atcnt, 01 mediated, learning is just anothei term, it 
seems, foi the same basic phenomenon 

This conclusion can be pci haps claiified, and further substantiated, 
by iccallmg the pioccduic (Mowici, i960, pp 106--108) which Skinnei 
began using moic than 20 \cais ago to facilitate a rat’s learning to 
pi ess a bai as a means of obtaining food Hcie the procedure, in brief, 

Tor fuithci cxpciinicntal analyses of this pioblem along interesting dimensions, 
see Mcehl S. AhcCoiquodalc (1953), Mucnzinger & Conrad (1953), Thistie- 
thwaitc (1951), Spence (ig^ia, pp 275-281), and Spence (1956) It is note^\orthy 
that Spence (1956) credits difficulties “that showed up in experiments on latent 
learning” with finally con\incing him of the untenability of the S — R bond con- 
ception of habit (cf Section VII) 



52 


LEARNING THEORY AND THE SYMBOLIC PROCESSES 


IS this With no bar yet piesent in the expeiimental apparatus, the 
rat learns to go to the food trough whenever it hears the noise which 
is produced by experimenter activation of the food-delivery mech- 
anism Then, after 20 or 30 such trials, the bar is made available and 
the rat itself can produce (“make”) the noise— and the attendant pellet 
According to the definition previously suggested — “some stimulus 
which will later be produced by a given response is first pioduced 
independently and conditioned to either hope or fear” — this is a very 
simple and explicit case of “latent learning ” 

Perhaps the misleading thing about the Blodgett experiment, and 
the reason it is a less good paradigm than the Skinner procedure — is 
that m the former the response (maze running) occurred first and the 
secondary reinforcement was then set up (presumably by virtue of food 
being received at and associated with a particular place) If hungry 
rats were first placed and fed, for example, in a gentle beam of light 
on the floor of an otherwise dark room, it w^ould not be at all sui prising 
if they later moved toward the beam when released at other places 
on the floor of the room This procedure would more nearly parallel 
the Skinner paradigm — and better illustrate “latent learning” in pure 
form 

This IS not to say, of course, that place learning was the 07 ily learning 
that occurred in the Blodgett experiment During the exploratory runs 
in the maze, the rats undoubtedly learned much about it, despite the 
fact that there was as yet no primary reinforcement Howevei, we must 
remember that the rat was probably being secondarily reinforced by 
little frustrations and satisfactions inherently (or adventitiously) as- 
sociated with the exploratory behavior (Alowier, i960. Chapters 6 
and 11) Thus wq arrive at the conclusion that the term “latent learn- 
ing” should not be used to refer, loosely, to any and all learning that 
occurs without primary reinforcement, instead, if it is to have piecision 
and technical utility, it should be restricted to situations wherein a 
stimulus which is later to be response-correlated is “baited” in advance, 
by being “preconditioned” to hope or fear, thus predisposing the sub- 
ject to make or not make some particular response or approach 01 
avoid some particular place Here the “transfer of training,” or gen- 
eralization, which IS so prominent in so-called latent learning, is from 
the situation in which the stimulus in question is independently pio- 
duced (and conditioned) to a situation m which it occurs (or is in- 
creased) as a consequence of something which the subject does Here, 
as is generally the case, the “transfer” is “mediated” by a common 
element (stimulus similarity) 



LATENT LEARNING AND MEDIATION 


53 


VI Other Examples of Response 
(Stimulus) Mediation 

Because the mechanism of mediation is so essential to the under- 
standing of latent learning and because it plays so important a role 
in the ‘‘higher” (language and thought) processes to be considered 
later, it is desirable to make this phenomenon as explicit and vivid as 
possible To this end we shall reproduce a portion of a previously pub- 
lished paper entitled, “The Psychologist Looks at Language” (Mowrer, 
1954) This material to some extent presupposes notions which will 
not be fully elaborated until Chapter 4, but the allusions made here 
to those notions will prepare the way for their more extended dis- 
cussion and better understanding later 

As Osgood has remarked, the concept of mediation is not devised “solely 
to meet the needs of semantics, it is the application of a general theory of 
learning to this particular class of phenomena” (1953, p 696) One of the 
experiments which is most relevant in this connection has been concisely 
summarized by Osgood as follows 

“Fortunately [he says] there are cases in which the mediation process is 
specifiable with some accuracy Shipley (1933) paired a faint light with a 
sudden tap on the cheek, which elicited winking, then the tap was paired 
with shock to the £nger, eliciting withdrawal, on subsequent tests, the light 
flash (never paired with shock) evoked finger withdrawal Since this did 
not occur unless the light and tap had initially been paired, any sensitization 
explanation is ruled out It becomes evident that the only difference 
between this experiment and those on sensory conditioning lies in the spec- 
ificity of the mediating reaction — here, the winking movement” (1953, 
pp 461-462) 

This experiment is schematized [in Fig 2-6] and provides a nice example 
of how It IS that a response, in this case the eye blink, can “carry” another 
response, finger flexion, from one stimulus (tap on cheek) to another (light) 
without the latter having ever been used either as a conditioned or an un- 
conditioned stimulus for the elicitation of the flexion response This, in 
essence, is the mechanism posited [see Chapter 4] to explain how it is that, in 
a sentence, a meaning conditioned to another meaning, 1 e , to the mediating 
response, can generalize or transfer back to the object presented by the sign 
that elicits the mediator or, more precisely, the response elicited by that 
object 

As will be more fully seen in Chapter 4, the Shipley experiment 
does not provide an exact parallel of what happens in language be- 
havior There the new meaning is acquired by the mediating reaction 
as produced by a word (conditioned stimulus) and generalizes to the 
thing (unconditioned stimulus) , whereas, m the Shipley experiment, the 
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new response (finger flexion) is conditioned to the mediating reaction 
(blink) as produced by the tap (unconditioned stimulus) and gen- 
eralizes to the light (conditioned stimulus) Experiments cited later 
in this section show that “semantic generalization” of conditioned re- 
actions occurs from thing to cognate word as well as from word to 
thing But ordinarily, in language, we are more concerned with the 
latter occurrence than with the former For the Shipley paiadigm 
to have been strictly parallel to this type of generalization, fingei 
flexion should have been conditioned to blink as elicited by light (a 
conditioned stimulus) so that the flexion could have generalized to the 
tap (or unconditioned stimulus) 

(1) Light 

(2) Tap^ Blink 

(3) Light — Blink 

(4) Tap — Blink-^^ 

(5) ShociT-^ Finger flexion 

(6) Tap — Blink — Finger flexion 

(7) Light — Blink — Finger flexion 

Fig 2-6 An example of response mediation discovered, rather accidentally, by 
Shipley (1933) The assumption is that m the second stage of conditioning (lines 
4 and 5) the finger flexion gets attached, not directly to the tap stimulus, but to 
the response (blink) produced by the tap (see line 6) (More precisely said, the 
finger flexion becomes conditioned to the proprioceptive and other stimuli pro- 
duced by the blink — or to the central equivalents of the blink ) And since light, 
as a result of the first stage of conditioning, is also capable of producing the blink 
reaction, it follows that the light, through the intermediation of the blink, will 
produce finger flexion (see line 7), even though the light has itself never been 
paired with shock, the unconditioned stimulus for finger flexion 


In trying to understand the Slupley experiment, students are some- 
times puzzled to know why it is not interpretable, quite simply, as a 
case of higher-order conditioning (MowTer, i960, Chaptei 4) It is cei- 
tainly true that much the same result could have been produced by such 
a piocedure Suppose that tap had been paired with shock (as in lines 4 
and 5 of Fig 2-6) so that tap alone would become capable of eliciting 
finger flexion (line 6) Then suppose that light and tap had been paired 
(lines I and 2), so that the first-order conditioned finger-flexion re- 
sponse to the tap IS now elicited, as a second-order conditioned lesponse, 
by the light (line 3) Here the response of finger flexion is, so to speak, 
transferred from shock to light without these two stimuli having ever 
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been directly associated This, from one point of view, was all that was 
accomplished in the Shipley experiment, so why the concern about a 
mediating i espouse or stimulus^ 

Theie is, however, one small but highly significant diffeience 
Whereas oidmaiv higher-oider conditioning would involve first the 
pairing of tap and shock and then the pairing of light and tap, the 
actual sequence in the Shipley experiment was just the reverse light 
was paiied vith tap and then tap was paired with shock The fact that 
light ^ull pioved able to elicit finger flexion can therefore apparently 
be accounted foi only in the manner suggested, by means of a mediating 
response (blink), it cannot be understood in terms of merely higher- 
order conditioning ® 

Let us now return to the article from which the preceding quotations 
came 

However, since the Shipley experiment was done without reference to 
the mediation hypothesis and with no particular attention being paid to 
the blink reaction in the second stage of conditioning, it is important to ask, 
as does Osgood 

®Or, might it not be interpretable as an instance of so-called sensory precon- 
ditjomng^ Here two presumably “neutral” stimuli, e g , a light and a bell, are 
temporally paired, and then the bell is paired with a prepotent, or unconditioned, 
stimulus such as food or electric shock If, subsequently, the light is presented and 
elicits a response appropriate to the unconditioned stimulus that has been used, 
“preconditioning” is said to have occurred In the Shipley experiment the light 
and the tap would correspond to the light and the bell (in the above example) 
and the tap and the shock to the bell and the unconditioned stimulus, so that 
the similarities are indeed striking However, mediated generalization seems to be 
well established as a phenomenon, whereas there is considerable doubt about sensory 
preconditioning Although a number of experiments on sensory preconditioning 
w^hich ha\e recently been reviewed by Rozeboom (1958) have given positive re- 
sults, the reviewer concludes that “any attempt to evaluate the magnitude of the 
effect strongly suggests that the phenomenon is a minor one, at least judging from 
the published studies Thus the empirical importance of preconditioning is still 
problematic” (p 30) The one obvious difference between the format for sensory 
preconditioning and for mediated generalization is that the second, or inter- 
mediate, stimulus is supposedly neutral in the one case, 1 e , produces no clearly 
defined response, whereas in the other case it is not neutral, e g , the tap in the 
Shipley experiment reliably produces an eye blink This difference suggests that 
instead of mediated generalization being an instance of sensory preconditioning, it 
is more accurate to say that sensory preconditioning is an (inferior) instance of 
mediated generalization and that the reason so-called sensory preconditioning does 
not ordinarily work very well is precisely the fact that the “middle” stimulus does 
not produce any very clear-cut response to serve the mediation function (Cf 
Mowrer, i960, Chapter 8, Section VII, also Kendler, 1959, p 54 ) 
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“But did this mediating winking reaction actually occur^ Lumsdaine 
(1939, cf pp 230 if in Hilgard & Marquis, 1940) has repeated Shipley’s 
experiment with detailed graphic recording His records indicate that, in 
most cases the light did elicit a winking movement which was closely fol- 
lowed by finger withdrawal There were some cases, however, m which 
the withdrawal reaction antedated the e\elid movement, and this suggests 
that the w inking mo\ ement may be only an ov ert index of the actual media- 
tion process This is what would be expected according to the mediation 
hypothesis in the original training, the light (sign) was presumably becom- 
ing associated with the fractional anticipatory portions of the reaction to 
tap-on-cheek (stimulus-object), and it is this mediation process which is 
more or less faithfully indexed by the overt winking” (1953, p 462) 

Elsewhere in his book, Osgood (see also Gofer and collaborators) cites a 
number of other instances of response mediation, reported mainly by Rus- 
sian investigators, in which responses conditioned to words readily gener- 
alized to the objects they represent and in which responses conditioned to 
objects generalized to cognate words Against the background of these find- 
ings, It IS not surprising 10 discover, as has Razran (1939), that a salivary 
response conditioned to one word, eg, “style,” will readily generalize to 
another word, viz , “fashion,” which is physically very different but which 
elicits much the same meaning or mediating reaction In fact, this investigator 
found that considerably more generalization of conditioning (59% as op- 
posed to 37%) occurred on the basis of similarity of meaning (synonyms) 
than on the basis of similarity of sight or sound (homophones, e g , in the 
present instance, to a w^ord like “stile”) That some transfer occurred on 
both bases suggests that, in the Razran experiment, the salivary response was 
conditioned not only to the meaning reaction produced by the word 
“style” but also, to some extent, directly to the word itself To the extent 
that this occurred we may say that salivation replaced the meaning response 
previously attached to this word, 1 e , its meaning was changed^ but this was 
not the only, or even the main effect, since transfer on the basis of the medi- 
ation mechanism was greater 

No, the notion of response mediation — Hull (1930b) spoke of “pure stimu- 
lus acts,” Hilgard and Marquis (1940), of “intermediate responses” — is by 
no means invented “to meet the needs of semantics ” It is a common and well- 
established phenomenon whose centrality in language can hardly be doubted 
and which apparently can alone explain, broadly yet simply, how it is that 
what we learn through sentences can generalize, or transfer, despite absence 
of any sensory similarity or continuum, both to other words of similar mean- 
ing and also to the realities thereby denoted 

Since the above w^as written, in i954’> niany new studies have appeared 
confirming the notion of mediation, both logically and empirically 
Goss (i960) has done an excellent historical review, and GrifEth, Spitz, 
& Lipman (1959), Jefrev & Kaplan (1957), Lipman & Blanton (1957)’, 
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Ray (1958), Rozeboom (1956), Staats & Staats (1957), and many others 
(see Kendler’s 1959 review) have reported experimental confirmation 
of deductions made from the theory We may therefore confidently 
say that the concept (phenomenon^) of mediation is here to stay, with 
only a few competent students of behavior still questioning it 

At the 1959 meeting of the American Psychological Association 
(see the American Psychologist for July, 1959), there was a sym- 
posium on “Mediating Processes in Verbal Behavior,” in which there 
was some debate, not about the reality of mediation, but concermng 
the mechanism theieof In contrast to the position taken by Staats 
(1959a) and most woikeis m the field, Bousefield (1959) and Russell 
(1959) took the position that so-called verbal mediation involves veibal 
(vocal or subvocal) response of an “associative” nature rather than 
meanings or representational reactions (see Chapters 5 and 6) In so 
doing, they overlooked, for example, the experimental findings of 
Razran (cited earlier in this section) on synonyms and homophones 
and other pertinent sources of evidence, apparently out of a feeling 
that the one type of explanation is much more “objective” than the 
other And Skinner and his followers have, rather generally, also re- 
jected the concept of meaning as a source of mediation, apparently 
for much the same reason Even in his recent work on the use of ma- 
chines for teaching arithmetic and other common school subjects, 
Skinner has insisted that “meaning” and “understanding” have nothing 
to do with the case and that, in the final analysis, what one is still 
doing (no less than in the training of lower animals) is progressively 
“shaping behavior” (1958b) 

Also at the 1959 meeting of the APA there was a paper presented 
by Gagne on “Teaching Machines and Transfer of Training,” in which 
the author took active issue with Skinner on this score and persuasively 
argued that in teaching a subject such as mathematics, whether by 
machine or human instructor, we must work, not for mere “predicta- 
bility of response” (1 e , “well-shaped” behavior), but for “breadth 
of applicability” of what is learned, for transfer, “understanding ” And 
this one can account for, on theoretical grounds, only if one posits the 
principle of mediation At a special conference at which Professor 
Skinner described his ideas and program for the use of teaching ma- 
chines, one listener’s considered appraisal of the approach was “Step- 
wise and leap-foolish ” Certainly we want students to be able to make 
“original applications” of what they learn, to be able to “think for 
themselves,” to make “leaps,” “transfers,” and not to be mere automata 
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Tbs IS not to say that one cannot use teaching machines to achieve 
this end, but, as Gagne was at pains to point out, we have to have 
mediated generalization — and the practical results it makes possible — 
in mind when w e program such machines, otherwise, the results are 
likely to fall far short of the desired goal 

But we are getting somewhat ahead of the story In succeeding chap- 
ters we shall again be talking about mediation in the more specific con- 
text of language, reasoning, and the like Before we can resume our 
discussion at this level of discourse, theie are, howevei, more back- 
ground and low er-order phenomena which need to be analyzed 

VII Latent Extinction 

As IS well knowm, behavior can be modified positively (facilitated) 
by reward and modified negatively (inhibited) by punishment More- 
ovei, both of these forms of learning can be undone by extinction, i e , 
by nonconfirmation of expectations previously established In other 
words, a bit of behavior wbch has previously been followed by reward 
tends to disappear if the accustomed reward is eliminated, and behavior 
wbch has previously been followed by punishment tends to reappear 
if the accustomed punishment is ehmmated These and related facts 
have been considered more fully in Chapter i (see also Mowrer, i960, 
Chapter ii), but they have an immediate relevance in the following 
way It has been estabhshed that latent learning, 1 e , change in be- 
havior without full performance thereof, can be made to occur with 
both decremental and incremental reinforcement The question now 
IS Can “extinction” also come about on the latent-learning basis, 1 e , 
without performance^ 

Sew’-ard & Levy (1949), m a paper entitled “Sign Learning as a Factor 
in Extinction,” were apparently the first investigators to bring this 
question to an empirical test They summarize their study thus 

An experiment was designed to test the sign-learning theory of extinction, 
the theory, namely, that when reward is removed CS becomes a sign of non- 
reward and CR drops out through lack of incentive The deduction tested 
was that CR could be weakened without itself being elicited, provided that 
the situation formerly associated with reward was now experienced with- 
out It 

The response selected was to traverse a narrow elevated path [30 in long] 
from one platform to another, the reward was found on the second platform 
Thirty-three rats were given 10 traming trials in tbs habit They were then 
divided into two groups, experimental and control Group E spent time on 
the goal platform without food both before and between extinction trials, 
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Group C spent equivalent periods on a neutral platform Both groups were 
extinguished to a criterion The results were as follows 

Group E reached the [extinction] criterion [of two successive refusals 
to leave the starting platform] in a mean of 3 12 trials, group C in 8 25 trials, 
the difference was significant at the 01 level (p 667) 

The most sti iking thing, of course, about these findings as far as the 
latent-learning issue is concerned is that animals in the experimental 
group showed a reduced tendency to run the maze on the first trial 
after exposure to the goal box without food therein This “habit” was 
thus not weakened by nonrewarded perfommnce — which is what ex- 
tinction IS usually thought of as involving — ^but by merely allowing 
the subjects to find the goal box empty when passively put therein 
This finding is therefore comparable to the results obtained, by Miller 
and Tolman & Gleitman, by the use of active punishment, rather than 
mere nonreward, in the goal box By the same logic, one would expect 
It to be possible to release an inhibited response by re-exposmg sub- 
jects, without punishment, to that part of an experimental situation in 
which punishment had previously been received This would be the 
counterpart of the type of “latent extinction” demonstrated in the 
Seward-Levy study If this type of experiment has not already been 
carried out, a report thereof — ^with positive results — can be expected 
shortly 

The validity of the Seward-Levy findings, just described, was ques- 
tioned in a paper published in 1952 by Bugelski, Coyer, & Rogers, 
but these findings have since received substantial support from studies 
reported by Deese (1951), Gleitman, Nachmias, & Neisser (1954), 
Moltz ( 1955), Moltz & Maddi (1955), Coate (i956),Moltz (1957), and 
Hurwitz (1955) We may therefore assume, at least tentatively, that 
latent extinction, no less than latent learning (in both its decremental 
and incremental forms), is an established phenomenon The question 
then becomes How is it to be explained^ In the studies reported by 
Miller and by Tolman & Gleitman, which involved punishment, it was 
apparently necessary, in order to obtain positive results, to require 
the subjects to make ceitam distinctive lesponses in connection with 
the experience of punishment (at one place) and the experience of non- 
pumshment (at another place) In the experiment carried out by 
Seward (Section V) latent learning was obtained solely by means of 

°For recent negative evidence, see studies by Scharlock (1954) and Rozeboom 

(1957) 

’”Cf a later study of Gleitman (1955) entitled “Place Learning without Prior 
Performance ” 
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reward, and no such responses were necessary, although Seward did 
find that the two end boxes of the T-maze which he employed had 
to be, in the absence of extra maze cues, visually distinctive Whether 
the sudden change in behavior noted by Seward after exposure of his 
subjects to the baited end box was mediated by the anticipatory oc- 
currence, at the choice point, of some sort of distinctive response made 
to the appearance of the baited goal box, or whether the changed be- 
havior was mediated, as Tolman prefers to think, by some immediate 
cognition or purely sensory memory, seems to be an open question 
(see Footnote 4, p 46) 

However, the interpretation of the Seward-Levy findings on latent 
extinction is simplified at least in this regard In this study there was 
only one goal box, and the experimenters tested latent learning simply 
by noting the tendency of their subjects to go or not to go to this 
box Hence the existence of response-mediated cues which might set 
this goal box apart from some other goal box is not an issue any goal- 
box response w^hich would occur anticipatorily, in the starting box or 
in the maze runway, could mediate learning (or unlearning) which had 
occurred in the goal box and thus affect runway performance Miller 
has already been quoted as saying 

Reinforced goal responses also occur regularly a short interval after 
stimulation by the cues from the starting box and from the alley Now, 
it is well known that if reinforcement regularly occurs a short interval after 
a given stimulus, a trace conditioned reaction to that stimulus tends to be set 
up and that there is a strong tendency for this trace conditioned reaction to 
antedate its reinforcement Thus there should be a strong tendency for the 
goal responses to occur [at least in attenuated, or “token,” form] in the alley 
and even in the starting box (1935a, p 182) 

Reference has been made (footnote 7, p 5 1 ) to the fact that Spence 
credits difficulties “that showed up in experiments on latent learning” 
with finally persuading him of the untenability of the S— R conception 
of habit and of Hull’s general conception of reinforcement Recently, 
however, Moltz & Maddi (1955) Moltz (1957) h^ve specifically 
defended the applicability of Hull’s principles here They say “If S 
were placed directly in the goal box without the presence of the reward 
object (a procedure called ‘latent extinction’) this w^ould reduce 
or eliminate the secondary-reward value of cues present in the goal 
box, and tbs would, in turn, lead to extinction through nonreinforce- 
ment or a decrease in reinforcement” (p 71) And empirically, these 
investigators found that the hu?igrier subjects (rats) are when sub- 
jected to latent extinction,” the greater is the extinction of the sec- 
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ondary leinforcement acquired by stimuli previously associated with 
primary remfoi cement Thus do the investigators cited derive an 
explanation of latent extinction consistent with Hullian principles in 
latent extinction, so-called, there is real extinction of important sec- 
ondary leinforcers, which extinction is then reflected bv a correspond- 
ing loss of vigor in the habit with which they have been associated 
Our own interpietation would diflFei in only one majoi Instead 

of assuming that some oveit icsponse or habit (conceived as an S — R 
bond) is “remfoi ced” by secondaiy remforceis and that extinction of 
the lattei would thus lemove a source of further “strengthening” for 
the foimer, we conjectuie that the secondary reinforcement which 
has become attached to response-correlated stimuli ts the “habit” and 
that if It IS extinguished so also, automatically and forthwith, is the 
habit (see Chapter i, Sections V and VIII, also Mowrer, i960, Chapters 
7 and 1 1 ) 

Habit theory, as developed by Thorndike and elaborated by Hull, 
does not, of course, deny — in fact, definitely affirms — that extinction 
(by withdrawal of primary leward) can be retarded by the operation 
of secondary leinfoicers But this type of theory does hold that a habit 
has some irreducible and inherent “strength” of its own, quite aside 
from that provided (subsequently) by secondary remforceis There- 
fore, if It could be shown that a previously well-rewarded response 
could be co 7 npletely imllified either by the elimination of all stimuli 
having secondary-reinforcement power or by extinction of that power, 
the notion of inherent “habit strength” would be hard to maintain (cf 
Mowier, i960, Chaptei 8) The evidence derived from research on 
latent learning generally, and on latent extinction m particular, seems 
to point m this direction It is not that a habit has first to occur and 
then be weakened by the absence of secondary reinforcement (as the 
Moltz-Maddi interpretation would imply) m latent extinction the 
habit IS weakened njoithout occuirmg, a circumstance which seems 
strongly to favoi the view that secondaiy reinforcement and habit 
strength are one and the same thing 

^Tewis & Cotton (1958) ha\e interestingly related the phenomenon of latent 
learning (and extinction) and that of partial reinforcement (Chapter i, see also 
Mowrer, i960, Chapter 12) How, they have asked, does intermittent latent rein- 
forcement (or intermittent latent nonreinforcement) compare in its effects with 
those of consistent latent reinforcement (or consistent latent nonreinforcement) ^ 
The problem is obviously a complicated one, and it is not surprising that the 
investigators cited obtained some complicated results These will not be discussed 
here, except to say that this is a promising area for future inquiry 
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Vni Mediated Discrimination or Distinctiveness 

The quintessence of mediation, as thus far considered in this chapter, 
IS that It IS a mechanism hereby a response which has become attached 
(through a mediator) to one stimulus can be made to generalize to 
other qme different stimuli (provided that they, too, elicit the media- 
tor) Since N E Miller was among the first to understand this phenom- 
enon clearly, it is natural that he, in collaboration with Dollard ( 1950), 
should also have elucidated the notion of mediated discrimination 
These writers say 

Attaching the same cue-producing response to two distinctive stimulus 
objects gives them a certain learned equivalence increasing the extent to 
which mstrumental and emotional response will generalize from one to the 
other (Birge, 1941, Foley & Gofer, 1943, Miller, 1935a) This may be illus- 
trated from our previous example of counting change Five dimes and a 
fifty-cent piece present cues that are innately quite different Since they 
both elicit the same label (le, verbal cue-producmg response), “fifty 
cents,” they have a certain amount of learned equivalence m our culture 
Similarly, the label of “Doctor” tends to mediate the transfer of con- 
fidence and response to anyone to whom it is attached 

Conversely, attaching distinctive cue-producing responses to similar stimu- 
lus objects tends to increase their distinctiveness To use the example of 
counting change again, an array of nineteen nickles is sufficiently similar to 
an array of twenty nickles so that few people would be able to make the 
discrimination by merely looking Whenever the nickles are counted, how- 
ever, they lead to the distinctive cue-producing responses “nineteen” and 
“twenty,” so that the discrimination is easy 

To cite another example, a faculty member was anxious, disappointed, and 
annoyed at not being invited to a large party given by a close friend These 
painful emotions motivated problem-solving behavior Turning it over in 
his mind, he suddenly noticed that all of the guests were members of the 
friend’s department, which was different from his own As soon as he labeled 
It “a departmental party,” his fear that he had offended his friend or had been 
ungenerously neglected, and his ensuing disappointment and aggression, 
were eliminated, he no longer had an emotional problem (pp 101-102) 

Just as naturally dissimilar objects or situations are, on occasion, made 
artificially (but none the less usefully) “similar” by means of mediated 
generalization, so are naturally similar objects or situations made arti- 
ficially (but, again, often very usefully) “dissimilar” by means of 
mediated discrimination The logical justification for the latter concep- 
tion is therefore very good, but thus far there are fewer empirical 
demonstrations thereof than we have for mediated generalization Re- 
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cently, however, Giice & Davis (1958) have reported an ingenious 
experiment in which both of these phenomena clearly appear They say 

Much of the work in this area has dealt with behavior of a rather high 
level of complexity and the cuc-producing responses have been regarded 
more often as inferred entities than as variables under experimental control 
(eg, Lawrence, 1949, 1950, Osgood, 1953) The experiments reported here 
represent an attempt to investigate the problem of mediated stimulus equiv- 
alence and distinctiveness at the level ot conditioning and with experimental 
manipulation of the cuc-producing responses (p 565) 

The authors desciibe the Shipley-Lumsdame experiments which have 
already been considered in this chapter (Section VI) and outline their 
own study thus 

The basic design involves a procedure of differential conditioning There 
are three clearly discnmmable tones varymg in frequency which may be 
called “High,” “Medium,” and “Low ” The medium tone is the CS [for an 
eyeblink response in human subjects], always paired with the UCS, a puff 
of air The high and low tones are negative stimuli never paired with the 
UCS Now if, during conditioning, S is instructed to make one manual re- 
sponse to the CS and one of the negative tones and a different manual re- 
sponse to the second negative tone, a paradigm for both mediated equivalence 
and distinctiveness is provided Equivalence should be mediated between 
the CS and the negative stimulus to which the same response is made, and 
distinctiveness should be mediated between the two negative tones and be- 
tween the CS and the tone to which the response is different In other words, 
the generalization gradients would be asymmetrical 

One may suppose (actually this was controlled by a counter-balanced 
experimental design) that there would be just as much inherent tend- 
ency for a human subject to show a generalization of eyeblmkmg from 
the Medium tone, let us say, to the High tone as from the Medium 
tone to the Low one How.ever, the High tone was made more “similar” 
to the A 4 edium tone by virtue of the subject’s being told to make 
the same mamial 1 espouse to these two tones, and the Low tone was 
made “different” from the Medium tone by instructions to the subject 
to make a dijfere 7 it manual response thereto Therefore, reasoned these 
investigators, if mediated generalization is a reality the tendency for 
the eyeblink response to occur to the High tone ought to be increased 
(over Its “normal” generalized tendency) and the tendency for the 
eyeblink response to occur to the Low tone ought to be decreased, 
le, “the geneialization gradients would be asymmetrical” 

Grice & Davis describe their findings thus 

There were [reliably] more conditioned eyebhnks to negative stimuli to 
which the Ss made the same manual response as to the CS than to those to 
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which they made a different response The results are interpreted as being 
in general agreement with a theory of response mediated stimulus equiv- 
alence and distinctiveness (p 570) 

There is, however, an ambiguity about this experiment which Grice 
Sc Davis fully recognize In order foi the proprioceptive and tactile 
stimuli produced by the two manual responses to serve as mediating 
cues, these responses would have to occur before the conditioned eye- 
bhnk response Otherwise, they could not mediate either generalization 
or discrimination The conditioned eyeblink can be extremely rapid — 
m fact, is commonly classified among the so-called short-latency con- 
ditioned reflexes — and so might well precede rather than follow a 
voluntary response to the same objective stimulus (1 e , tone) There- 
fore, in an effort to obviate this difficulty, Giice & Davis allowed 
an interval of 500 milliseconds (one-half second) between the onset 
of the CS and the UnCS (in the hope of somewhat slowing up the 
conditioned eyeblmks) and excluded from their tabulations all eyelid 
responses that occurred less than 150 milliseconds after the onset of 
the CS, thus providing a greater opportunity for the distinctive manual 
responses to occur before, or at least with^ the occurrence of the eye- 
blink There are, how^ever, still complications heie which prompt the 
authors to suggest that perhaps just the “set” to make a particular 
manual response which is centrally aroused by the CS “may have a 
mediating effect” (p 570) The authors indicate (personal communica- 
tion) that they now have research in progress which is designed to deal 
more definitely with these problems — perhaps the solution would be 
to use an emotional response rather than a short-latency reflex, but, 
in any event, the experiment aptly illustrates the prmciples which are 
at issue here, and, despite the difficulties, it still produced results of the 
predicted kind 

IX. Summary 

Several experiments have been reported which show that, given the 
right circumstances, behavior can be facilitated, extinguished, or in- 
hibited ‘Without occurring These findings go counter to the dictum 
that organisms learn (or unlearn) “only by doing”, and such results 
cannot be explained on the basis of any simple stimulus-response, or 
“bond,” conception of habit But neither do they demand that we 

^ For an interesting, but somewhat different, approach to the problem of mediated 
generahzauon and discrimination, see Goss (1955) And see also the articles cited 
in the literature review near the end of Section VI 
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revert to a cognition psychology They can be handled, quite nicely, 
by means of the concept of mediation In the final analysis, mediation 
IS always stimulus mediation, but the mediating stimulus may be in- 
dependent, or It may be response-correlated, in which case we are 
likely to speak (somewhat misleadingly) of “response” mediation An 
illustration will be useful 

Suppose that our object is to teach a hungry rat to go to the right- 
wing goal box of a T-maze for food, but “without practice ” Gen- 
eralizing fiom experiments actually performed and reviewed in pre- 
ceding sections of this chapter, w^e may infer that if a rat were passively 
carried (without vision) to the light goal box, placed therein, and fed 
with a distinctive tone sounding nearby, the lat would be more likely, 
when subsequently put into the maze at the base of the stem, to go to 
the right-wing goal box, i e , toward the tone, than it would be to go 
to the left-wing goal box, i e , anx^ay from the tone 

Or, suppose that our object is to inhibit a well-practiced response 
of some soit, without “punishment” First we allow the rat, when 
hungry, to discovei that it can obtain food m either of the two goal 
boxes of a T-maze Then \ve place the lat in one of these boxes, say 
the left one, and shock it, in the presence of the tone When later placed 
in the staiting box, this rat will (with tone again sounding near the 
left goal box) be considerably less likely to go to the left goal box 
and more likely to go to the right goal box, although it has previously 
shown no such piedisposition and has ceitainly never been “punished” 
for going from the starting box to the left goal box 

In both of the instances just described, the phenomenon of stimulus 
mediation (or generalization) is extremely obvious An emotion of 
hope or fear is conditioned to a tone in one situation, and later, when 
the tone is heard at a distance^ the hungry subject will be more or less 
disposed to go to that situation, depending upon whether the emotional 
conditioning has been positive or negative 

Stimulus mediation becomes subtle, and interesting, only when the 
mediating stimulus is response-produced, rather than provided by the 
environment But it is still easy to see that if, in one situation, an or- 
ganism makes some distinctive response and experiences a paiticular 
pattern of “feedback” and is then either rewarded or punished, and 
if, in later moving toward this situation the organism “anticipates” being 
in the situation, i e , makes some part of the response previously made 
(and rewarded or punished) therein, then this response and its corre- 
lated stimuli will call out either hope or fear, and the organism’s progress 
toward the situation in question will be adaptively speeded or slowed 
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(stopped), as the case may be By thus appropriately responding at a 
distance (generalizing), the subject is said to show foresight 

Thus, by the examples given, one sees that overt behavior can be 
either “stamped in” or “stamped out” without having been directly 
associated with either reward or punishment, and the indications are 
that an inhibitory effect, similar to that produced by incremental rein- 
forcement, can be produced by mere nonreward (disappointment, 
frustration, “extinction”) 

Several instances of so-called latent learning, latent punishment, and 
latent extinction have been analyzed in this chapter in terms of either 
response-produced or independent stimulus mediation, and it would 
appear that mediation is the key to an understanding of all such phe- 
nomena Manifestly v^e are here dealing with mechanisms similar to 
those involved in “semantic generalization” (Chapter 4), in “insight” 
(Konorski, 1950, explicitly equates it to “latent learning”), and other 
higher mental processes (Chapter 5), and in the control of behavior 
through feedback (Chapter 8) Also we see, once more, the advantage 
of thinking of habit strength as a function of whether fear or hope is 
attached to response-correlated stimuli, rather than in “connectionistic” 
(S — R bond) terms 

The various instances of latent learning (including extinction and 
punishment) which have been considered in this chapter are dependent 
upon mediated generalization, le, some stimulus (independent or 
response-dependent) which makes the test situation more like (gives 
It something in common ijoith) the situation m which the original learn- 
ing (extinction or punishment) occurs However, it is now known that 
discrimination can also be “mediated”, 1 e , where an original learmng 
situation and a test situation are natuially somewhat alike and therefore 
likely to show generalization, they can be made artificially different, 
by means of distinctive cue-producing responses made to each This 
phenomenon has been clearly conceptualized by Dollard & Miller and 
empirically exemplified by Grice & Davis However, misunderstanding 
should not be allowed to arise here The term mediation, as it is ordi- 
narily used, implies a medium, something that goes between or is com- 
mon to two or more situations So-called mediated discrimination im- 
plies, in one sense, exactly the reverse picture one in which two situa- 
tions which are inherently alike are made different And in order for 
this to occur, not a “mediator,” but two distinct and disparate stimuli 
are introduced They do iiot “go between” (mediate) two different 
situations, each, so to say, “stays put” and so increases the uniqueness 
of the situation in which it occurs 
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Therefoie, one can say that the term, mediation, is applicable only 
where generalization is ‘‘artificially” produced and that some other 
term should be available for the situation where discrimination is, in 
like manner, “artificially” produced Only the artificiality (provided 
by response-produced cues) is common to both generalization and 
discrimination of this kind, otherwise they are quite different But 
there is probably no harm, established usage being what it is, in con- 
tinmng to speak of both mediated generalization and mediated dis- 
crimination, piovidmg that we lemember that the generalization is 
'‘mediated” in a much moie liteial sense than is the discrimination 
A word should also be said about another minor ambiguity in this 
chapter The bulk of our discussion has dealt with the mechanism 
whereby two objectively different situations can be rendered more 
nearly equivalent, psychologically and functionallv, by means of 
response-pioduced mediating stimuli However, as intimated in the 
introduction to this chapter, it is also possible foi mediation to function 
in the purely temporal dimension Often a situation at ti (in time) will 
be objectively the same as at tj, but at ti the stimulus trace of some 
recent event will still be piesent, whereas at t2 it will have disappeared, 
thus rendering situation ti and situation t2 subjectively dijferent This 
change, or loss of “equivalence,” bemeen ti and t2 becomes highly 
important in circumstances involving delayed reinforcement (decre- 
mental or incremental), wherein a stimulus event which has occurred 
(and left its trace) just prior to ti is functionally related to events that 
occur at tj However, because of the disappearance of the stimulus 
trace of the antecedent event, the two objectively identical situations 
(ti and to) will have become subjectively different, and, as a result, 
the “connection” between the antecedent stimulus event and the sub- 
sequent reinforcing event will be “lost” As indicated in Chapter lo of 
Leartimg Theory avd Behavior, such an interval can be spanned in a 
variety of ways, but the one most inteiesting from the standpoint of 
the present discussion is that in which the subject introduces behavior 
(“pure stimulus acts”) which will make the situation at t2 “artificially” 
more like the situation at ti than it otheiwise would be In the chapter 
cited, an animal experiment by Ferster (1953) is described which 
nicely exemplifies this phenomenon And it is even more remarkably 
and peivasively illustrated by the use of language by human beings, to 
which topic we shall shortly turn in the two following chapters 
However, befoie proceeding with the study of symbolism in its 
more elaborate foims, a few" further observations should be made con- 
cerning the idea of mediation Anyone who has read the companion 
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volume, Learning Theory and Behavior , or who knows this field fiom 
other sources, is familiar with the concept of intervening variables 
and may, at this point, quite reasonably find himself wondering about 
the relation of this concept to that of mediation A mediator obviously 
is a ‘Variable,’’ and it also “intervenes” between an objective situation 
and overt behavior But are all intervening variables also mediators, 
and if not, wherein do they differ^ 

In 1948 MacCorquodale & Meehl devoted a long article to a dis- 
cussion of intervening variables (as conceived by Tolman) and their 
relationship to “hypothetical constructs” (particularly as employed 
by Hull) But no one, it seems, has addressed himself systematically 
to the question of the relaaon between intervening variables and 
mediators Nor shall we here attempt to deal with this problem in 
any exhaustive fashion We may, however, usefully break ground 
for later exploration by looking, once again (cf Mowrer, i960, espe- 
cially Chapters 3 and 9), at this matter of intervemng vaiiables As 
MacCorquodale and Meehl properly note, an intervening variable 
IS a variable that intervenes between a so-called independent variable 
and a dependent variable, 1 e , between a manifest cause and an ob- 
served consequence or effect of some sort Now the concept of inter- 
vening variable arose, in psychology at least, out of the patent inade- 
quacy of simple S — R theory It was soon found, for example, that 
the response (conceived as overt behavior) which a conditioned stimu- 
lus, or signal, elicits may be very different from the response made by 
the subject to the unconditioned stimulus, and this difference is likely 
to be especially striking when the unconditioned stimulus is painful, 
noxious The only satisfactory way, it seems, to account for this dis- 
crepancy is to assume that what gets conditioned, directly, to the 
danger signal is fear and that it may then motivate any of a variety of 
overt behaviors, depending upon what the organism’s prior experience 
has been in dealing with this dnve Here the reality of the fear, as an 
intervemng variable, is easily demonstrated empirically as well as sub- 
jectively, and Its postulation has gained general acceptance in con- 
temporary behavior theory 

Some 15 years ago, the author wrote to Professor Tolman asking if 
the concept of fear, as it was then coming into systematic use, would 
qualify as an intervening variable, in the sense in which he used the 
term Tolman’s reply was equivocal He did not deny that fear is one 
kind of intervening variable, but he distinguished it from the kind of 
intervemng variable in which he, personally, was most interested, 
namely, cognitions (see Chapter 5) rather than emotions What can 
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now be done by way of relating these two kinds of intervening varia- 
bles, or ''mediators” 5 

In a certain limited sense, all co7iditioning^ as that phenomenon is 
conceived in this w^oik, may be said to involve "mediation” If, for 
example, the combination of a signal and a noxious stimulus (such as 
electiic shock) is thought of as the learning, or acquisition, situation, 
then the occuirence of the signal alone may be teimed the test situa- 
tion, and fear, as elicited theiem, may be said to provide a common 
element, or to "mediate,” between these two situations The fact that 
the fear now occurs in the test situation makes that situation more like 
the learning situation and prompts more oi less appropriate anticipatory 
behavioi therein Therefoie, in at least a loose, general sense of the 
term, feai is not only an intervening variable, but also a "mediator ” 
And in this sense, we can argue that other emotions, to the extent that 
they are conditionable, aie likewise mediational They are what make 
It possible for living oiganisms to react to a signal (really to an emo- 
tional "mediatoi”) more or less as if it were the "real thing,” to their 
decided biological advantage 

But It is also evident, from earlier sections of this chapter, that not 
all mediatoi s aie emotions, many, in Hull’s apt phrase, are "pure stimu- 
lus acts,” with no motivational or reinforcing properties in their own 
right These "acts” are nevertheless important and useful because the 
stimuli which they produce do arouse emotions, and thus prompt and 
guide ensuing behavior 

Thus we arrive at the suggestion — perhaps a rather significant one — 
that there aie diffeient kinds, or levels, of mediation An emotion is 
a mediator of the first order j a pure stimulus act (or a mediational 
stimulus supplied by the environment) to which an emotion (or first- 
order mediatoi) is conditioned is a seco7id-order mediator And we 
may later discover that it is possible to have "purely mental” (cogni- 
tive) surrogates for puie-stimulus acts (as Tolman has proposed) 
which might be said to constitute mediators of the third order Media- 
toi s of the lattei kind will be given special consideration in Chapter 5 
(see especially the discussion of images), and in Chapter 7, we shall 
find a paiallel notion m the woik of Powers, McFarland, & Clark 
(1957), on a cybernetic model foi "peisonality” and the higher men- 
tal processes The pioblem, in veiy general terms, will also be con- 
sidered in Chapter 6 



Learning Theory 
and Language Learning: 
The Problem of ^Lmitation 




As the preceding chapter indicates, the phenomenon of mediation 
provides a “bndge” or transition from the relatively simple principles 
that govern ammal behavior to the more elaborate “intellectual” or 
“symbolic” processes found m man Words are, in fact, “mediators” 
par excellence, and it is natural for us now to undertake a systematic 
study of their acquisition and function 
Language and learning have a curiously interactive, or reciprocal, 
relationship language is itself learned, but, once learned, it then im- 
portantly facilitates and guides further learning These two aspects of 
the relationship seem to be sufficiently important and sufficiently dif- 
ferent to warrant separate chapters, the present one being devoted to 
language learning and the following one to learning through language 
The systematic analysis of language learning, we shall find, generates a 
surprisingly satisfactory conception of imitative behavior in general, 
and one that articulates easily and meaningfully with the concept of 
“habit” as it emerges in revised two-factor learmng theory 

I The Understanding and the Use of Words 

The learmng or acquisition of language breaks down into two 
phases understanding and reproduction, references and responses, 

70 ^ 
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meanings and motions Bertrand Russell, a good many years ago (1927), 
suggested that words acquire, or are given, meanings through condi- 
tioning “ball” (woid) IS associated with ball (thing), and at least a 
part of the reaction evoked by the latter gets connected with the 
former On the other hand, learning to make the noises which we call 
words depended, according to Russell, upon what has commonly been 
called tnal-and-eiioi learning An infant, more or less accidentally, says 
“ball” (or something like it), is objectively rewarded in some way, 
and becomes disposed to repeat the lesponse This distinction clearly 
corresponds to w hat, in the eailier veision of two-factor learning theory 
(see Chapter 3), weie termed sign learning and solution learning 
Words, as heard, aie signs, as made by ouiselves to others, solutions 

But now, in terms of the revised two-factor position adopted in 
this book, V hich reduces all learning to sign learning or conditioning, 
type-I and type-D, what happens to this distinction^ There is no 
problem as far as the learning of word meaning, reference, or signifi- 
cance is concerned If a word, as heard, is temporally contiguous with 
a thing, person, or event which is itself “meaningful,” a part of that 
meaning wall become attached to the word Things and events are 
meaningful mainly in the sense of being good or bad, helpful or 
harmful, and it is precisely these two effects that have, as we have seen, 
the capacity to act as lemforcmg agents and to cause stimuli which 
are contiguous therewith to take on the surrogate properties of sec- 
ondary reinforcement and secondary motivation, respectively 

There is, of couise, manifestly more to the meaning of words than 
this puiely evaluative aspect Thus “apple” implies beauty, good smell, 
good taste, and hunger reduction, but it is also uniquely designative 
of a particulai category of leal objects, le, it has certain properties 
which are seemingly independent of its affective implications (Carroll, 
1953, pp 95-97) As yet w^e aie not prepared to discuss these (see 
Chapter 5) But piesent indications aie that the affective, evaluative 
element in w^oid meaning is, in any case, basic A study of the meanings 
of woids, made possible by an objective method described by Osgood 
and Suci (1955), show^s that the good-bad dimension accounts for about 
70^1 of all the meaning w^hich woids have So the reaction of feai, 
01 of hope, aioused by a w^oid is a good place to start in studying 
meaning, and two-factoi theoiy, as now conceived, piovides a specific 
basis for the acquisition of these affective aspects of meaning (see 
Fig 1-5) 

But what of tw^o-factor theory and the process whereby the human 
infant learns to reproduce, 01 say, words^ The most widely accepted 
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view IS that woid learning, like other instances of ‘‘habit formation,” is 
dependent upon trial and error This is the assumption put forward by 
Russell in the work already cited, and it permeates the writings to be 
found on this problem in a variety of fields— psychology, philosophy, 
speech, etc To borrow an expression used by Thorndike in a different 
context (see Section V), we may term it the “babble-luck” theory, 
since It presupposes that the infant, in the course of babbling, has the 
luck, once in a while, to make a noise that to others sounds like a 
word Such a noise, or “word,” elicits attention and other rewarding 
behavior on the part of the parents, and in this way, supposedly, the 
responses, or “habits,” involved in speech are learned 

This is not an illogical theory, but it is improbable Most parents 
apparently do not look upon what they do to get their children to 
talk in quite this way instead of passively waiting for the baby to 
make a conventional word noise, they themselves talk to the baby and 
then rely upon something which they term “imitation” to do the rest 
What does this “imitation” imply^ 

If we adopt the revised two-factor assumption that all learning is, 
m the final analysis, a form of conditioning, what implications does 
such an assumption have for the problem of language learning^ The 
early conception of conditioning obviously will not work in this con- 
nection When Behaviorism was most popular, during the 1920’s, con- 
ditioning was seen mainly as a process whereby an external, behavioral 
response of some sort, which could be reliably elicited by a so-called 
unconditioned stimulus, would become capable of being elicited by a 
new, formerly neutral stimulus, as a result of paired presentation of this 
and the unconditioned stimulus Such a conception of learning is, of 
course, not very useful in explaimng word acquisition, for the reason 
that there are no “unconditioned” stimuli which can be relied upon to 
elicit words, on an unlearned, reflexive, nativistic basis The knee jerk 
can be reliably produced by a blow on the patellar tendon, and it can 
be conditioned (at least in some subjects) to another stimulus which 
is associated with the tendon tap But words (like most behavior), not 
being reflexive to begin with, cannot be acquired as “conditioned 
reflexes” (see Section VIII) 

How, then, can conditiomng, as defined in two-factor theory, ac- 
count for word learmng — if at alP Oddly enough, the present version 
of two-factor theory was worked out and first applied in relation to 
the problem of language learmng, before it was understood and stated 
in Its more general form The background facts are these In view of 
the many divergent hypotheses which had been advanced concermng 
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the nature and course of language learning by human infants, it seemed 
that something more specific and definite might be learned if a sys- 
tematic study was made of the circumstances under which parrots and 
other species of birds learn to make human, word-like sounds This 
work has been reported in detail elsewheie (Mowrer, 1950, Chapter 
24), but the upshot was this In order for a bird to learn to make a 
particular woid sound, that sound has first to be heard, repeatedly, 
m a pleasant, agreeable context Varied evidence indicates that if a 
sound, such as “Hello,” is uttered as the trainer comes into the presence 
of the bird after an absence, or if the sound is repeated as the trainer 
gives the bird food and water, scratches its head or neck (an attention 
particularly appreciated by parrots), or amuses or comforts the bird 
in some other way, the bird will sooner or later start using the word, 
both in the absence of (as if calling for) and in the presence of the 
trainer, as a means of securing “services” which the trainer can provide 
When this research on training birds to “talk” was being carried out 
(1946-48), enough was already known about secondary reinforcement 
to suggest that this phenomenon was importantly involved The ex- 
planation seemed to go like this As a result of being repeatedly uttered 
by the trainer in conjunction with some dependable, “primary” form 
of decremental reinf 01 cement, a given word or phrase, as heard, takes 
on secondary-reinf 01 cement properties When, subsequently, in its ver- 
bal play or “babbling,” the bird makes — and itself hears — a sound some- 
what like the word, there will be leady-made, or “built-in,” reinforce- 
ment of the response, and the more nearly the sound made by the bird 
approximates (or “imitates”) the sound made by the trainer, the more 
it will be, in this way, reinforced and repeated Imitation, as thus in- 
terpreted, becomes a sort of automatic trial-and-error process, one 
which IS dependent upon reward from another organism, or “parent 
person,” only in an indirect, derived sense The response has become 
“baited” so that whenever the bird makes it, satisfaction and rein- 
forcement will be powerful and prompt — and self-administered^ — ^pro- 
vided appropriate motivation is present 
Another, perhaps clearer, way to put this idea is to say that the 
secondary reinf 01 cement which has become conditioned to the word 
stimulus as made by the trainer ge^ieralizes to the word stimulus as 
made by the bird itself And since our supposition is that habit is just 
the secondary reinforcement, so-called, which has become attached to 
response-correlated stimulation, then, in “imitation,” the bird acquires 
the “habit” of making a particular sound, not by making it, but by 
merely hearing it made This, obviously, is just a special case of the 
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principle of latent learning discussed in the preceding chapter As we 
have seen, latent learning, in the final analysis, is simply a matter of 
generalization or transfer of training This, it seems, is also what is 
involved in imitation ^ 

Sometimes the phenomenon of imitation has been interpreted as due 
to a special “instinct” (cf Thorpe, 1956) Thus, if one organism “imi- 
tates” and another does not, this is said to be because of the presence 
or absence of an “instinct of imitation ” We have reduced the phenom- 
enon to very general learning principles, yet it is well known that word 
learning is possible only in human beings and certain species of birds 
(with chimpanzees and dogs having the capacity in only very rudi- 
mentary degree 2) So if it is not an “instinct of imitation” that varies, 
how then can the observed wide variations in performance be ac- 
counted for^ The answer, apparently, is that the “motor connections” 
required for making word-like responses are simply not present in 
most living organisms and no amount of teaching or learning can bring 
them into existence Chimpanzees seem to have all the physical equip- 
ment required for word formation, the deficit is mamfestly neurological 
(see Section VIII) And even the generally “talkative” little parakeet 
finds some sounds naturally difficult 

li Word Learning and Other Instances 
of ^'Habit Formation" Compared 

The two following illustrations, with which we have already become 
familiar, may help clarify and concretize the view of word learning 
which has just been sketched Knowledge of how to teach a dog to 
“shake hands” (see Mowrer, i960, Chapter 7) is commonplace This 
IS not ordinarily done by showing the dog, visually, how to shake 
hands, nor is it done by waiting, tid-bit in hand, for the dog to lift one 
of his front paws in a particular manner The procedure consists instead 

^ As will be made more explicit in Chapter 7, this way of thinking about learn- 
ing in general and imitation in particular is compatible with the basic assumpuons 
underlying the new discipline of cybernetics For a discussion of language and 
related problems in the context of cybernetic theory, but without reference to 
any of the seemingly very naturally related ideas considered here, see a series of 
papers appearing in a volume edited by Von Foerster and published in 1951 For 
an appreciation of this relationship, see Peterson (1955) 

“In 1956 Will Rogers, Jr , on his TV “Morning Show,” offered cash prizes for 
each clearly distinguishable word uttered by “talking dogs” Several dogs that 
were exhibited by their masters received two or more such prizes For a report 
on “talking chimpanzees,” see Section VIII 



LANGUAGE LEARNING AND IMITATION 


75 


of passively moving the leg and at the same time petting the dog or 
perhaps giving it some prefen ed food In this way, the particular pattern 
of stimulation fiom muscles, tendons, and joints which is produced by 
the passive flexion of the leg takes on secondary-reinforcement prop- 
erties, and wdien, after several lepetitions of this training procedure, 
the dog himself starts to move his leg in the same way, the movement 
somehow “seems light,” “feels good,” and will be carried through to 
completion, because it maximizes the attendant secondary reinforcement 
or deiived, “autistic” satisfaction 

At this point, the dog’s master begins to notice the apparently spon- 
taneous, or “voluntary,” occuiience of the response, himself feels re- 
warded foi his effoits, takes the paw and again rehearses the response, 
all the while lavishing new approval upon and perhaps more concretely 
rewarding the dog Hence, just as a word, acquired on an autistic (self- 
satisfying) basis by a bird or baby, may then become “instrumental” 
in producing predictable behavior on the part of others, so does the 
gesture on the part of a dog of “offering” to shake hands come to have 
a social, or signalings function, and we are likely to say that the dog 
IS now “begging” foi food or for some other form of “attention ” 
Howevei, in both word learning and “hand shaking,” it is to be re- 
membered that the lesponse is “conditioned,” or ^‘preconditioned,” in 
the sense that certain stimuli which will occur when the response is 
voluntarily pei formed are fiist produced through the efforts of others 
and in a context which will cause them to acquire secondary-reinforce- 
ment power Hence, when the organism which has received this kind 
of training itself happens to behave in such a way as to produce roughly 
the same pattern of stimulation, the secondary reinforcement transfers 
or geneializes — and a “habit” will be discovered to have come into 
existence ^ 

As already suggested, a i espouse may be tried again and again by 
the subject, so as to make the pattern of stimulation produced by 
voluntary performance of the response coirespond as closely as pos- 
sible to the pattern of stimulation which has originally acquired the 
secondary remfoicement (see Mowier, i960. Chapter 12 for a discus- 
sion of “skill”) In this sense it is indeed true that “practice makes per- 
fect”’ And once the action is recognized by others as “imitative,” it 

® Suppose that a dog’s foreleg naturally made a squeaking sound when acutely 
flexed If this sound was produced “artificially,” either by flexing the dog’s leg 
passively or in some other way, and followed by food, it would not be surprising 
if the dog started “making it himself ” This is all that is presumed to be involved 
in word learning or in “hand shaking ” 
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may receive new, direct, primary reinforcement But the basic notion 
here is that, originally, learmng does not necessarily involve domg, 
as has so often been maintained The important thing is simply that, in 
order to acquire secondary-reinforcing properties, a given pattern of 
stimulation be contiguous with primary (or secondary) reinforcement 
It not uncommonly happens, of course, that a particular pattern of 
stimulation can be experienced 07ily when the subject himself behaves 
in a particular way In such a case, about all the would-be teacher or 
trainer can do (with nonverbal, ammal subjects) is to wait for the 
response to be made (or at least approximated) by the subject and 
then, as we say, “rew^ard it ” But this is the limiting case, not the most 
general one It seems that the mechanics of ‘'habit formation” are most 
transparently seen when a given pattern of stimulation can be produced 
by others and thus brought into repeated contiguity, for the subject, 
with reinforcement Then, whenever the subject (properly motivated) 
himself behaves so as to reproduce this pattern of stimulation, such 
behavior will immediately have the properties of a “habit ” Hence we 
see that the basic condition for learmng is not necessarily doing, but 
rather contiguity of a particular constellation of sensation with rein- 
forcement 

Reference has repeatedly been made in Learmng Theory a^id Be- 
havior to the technique developed by Skinner as a means of getting a 
laboratory rat to push a bar more quickly as a means of obtaining 
food The trick here consists of giving to some of the stimuli inher- 
ently associated with the occurrence of this response potency be- 
fore the response ever occurs Then, when the bar is made available 
and, in the course of random exploration, is pressed, the habit is already 
in force and “ready to go ” This procedure involves precisely the 
same principles as does the procedure according to which talking birds 
and human infants learn to make (imitate) words In the Skinner 
situation the bar-pressing response is ordinarily followed, not only by 
the stimuli which have already acquired S'" power, but also by pri- 
mary reinforcement (food) The same is true in the word learning 
situation when a bird or baby begins to “do it himself,” impoitant 
and satisfying things, of a very tangible nature, are likely to happen 
to him But this is by no means essential, at least not immediately so 
Skinner himself and others have shown that a very respectable little 
“habit” can be set up on the basis of secondary reinforcement alone, 
and the indications are that the same holds for words 

There is, however, this difference In the case of a rat and a Skinnei 
bar, the technique of “baiting” is merely an advantage, not a necessity, 
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whereas, in teaching small children and birds to say words, this is the 
only procedure that works Tnal-and-error methods, with primary 
leinforcement alone, aie too slow and uncertain to be at all practical 

In some ways it is suipiising that the “autism” theory of word learn- 
ing and, indeed, the entire new^ conception of habit w^hich is de- 
lineated in this book did not suggest themselves to those who have 
used the method of “pietiammg” just mentioned It is, so to say, “all 
theie ” However, as far as Skinner is concerned there has been a 
singular preconception that in no oigamsm other than man is it pos- 
sible for vocal responses to function as what he calls true “operants,” 
le, voluntary, instrumental, habitual responses'^ This has prevented 
serious consideration of the talking birds as experimental subjects in 
this connection, to say nothing of other orgamsms When J Konorski 
was in this country, late in 1957, ^e reported that some of his fellow 
researchers have confirmed in the laboratory the common impression 
that dogs can be taught to bark, instrumentally (cf Lawicka, 1957a) 
There was, however, this difficulty When a dog is taken into a strange 
experimental situation, he is likely to become very quiet and indis- 
posed to bark It may, in fact, be so long before he emits such a re- 
sponse that, for all practical purposes, one may say that the response 
does not occui, and, in terms of ordinary habit-traimng methods, the 
response has to occur before it can be strengthened 

The expedient reported by Konorski and his colleagues was this 
In the living quarters, several dogs are housed together, with the result 

^In an unpublished but much publicized dissertation written by Greenspoon 
(1950) at the University of Indiana, evidence has been presented for believing 
that adult human \erbal behavior obeys the same principles as does “operant” 
(instrumental) behavior in general namely, that it can be selectively facilitated 
by rewards (in this case, grunts or nods of social approval) and that, moreover, 
changes m the types of words “emitted” can be produced without awareness on 
the part of the subjects of such a change Verplanck (1956) has worked out a 
more refined and reliable method of studying this phenomenon, and an extensive 
program of research in this field is now being carried out by Dulany (1955, 
i960) The exact nature and import of the results is still under debate, but it 
seems likely that trul). “unconscious” learning has now been demonstrated in 
this connection If so, this fact poses certain problems for the autism theory of 
word learning and for our general conception of learning, with its stress on 
“central” concomitants of the learning process An example of apparently un- 
conscious motor learning is cited near the end of Chapter 12 of Learning Theory 
and Behavior and poses the same sort of difficulties Although revised two-factor 
theory satisfactorily accounts for a wide range of phenomena, we count it no 
discredit to the theory that certain observations appear to challenge it This fact 
at least indicates that the theory is testable — and therefore scientifically meaning- 
ful (cf Chapter 6, especially Section X) 
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that there is a good deal of spontaneous barking, occasioned by the 
general social (“emotional”) situation Here a hungry dog will be sin- 
gled out and whenever, under the stimulation of this situation, he 
barks he is fed The result is that his barking, in this situation, will be 
facilitated, to the point that eventually it is so well established— not 
just as a social response, but as a specific device foi “begging” foi 
food — that it will transfer to other situations 

An instructive variation of this procedure would be the following 
By means of a tape recorder one would obtain some exhibits of a 
dog’s own barking in his living quarters Then both the dog and the 
tape recorder would be moved to an experimental room Here the 
dog, now hungry, would periodically be allowed to hear some of his 
own recorded barking and then be given a bit of food The stimulus 
consequences of the desired response would thus acquire potency, 
and it would be very surprising if the dog himself did not soon start 
making the barking response Since the recoided bark would be some- 
thing which the dog w^ould very much wish to hear (because it would 
indicate the imminence of food), the dog would have every incentive 
for wishing to hear himself make the response — and this, we conjecture, 
IS the essence of habit The fact that the “model” is here provided by 
a recording of the dog’s own performance (in another situation), rather 
than by a vocal noise (word) made by a human being, does not, of 
course, mean that the principles involved are any different from those 
involved in the imitation that occurs m language learmng — or, as we 
have seen, in instances of latent (mediated) learmng m general 

We are dealing, apparently, with principles of wide generality^ 

^ Since this chapter was written, Zimmerman, (1958b), under the author’s direc- 
tion, has performed an experiment with dogs of the kind indicated The results were 
completely negative f Despite mtenswe training, over a period of several weeks, 
not one of fi\e kennel-bred Brittmary Spaniels and four assorted house-pet dogs 
learned to bark when hungry as a result of hearing their own recorded barks and 
then being fed In light of the varied evidence already cited and more to be 
cited, this finding is most remarkable Whether it discredits the theory which the 
experiment was designed to test or tells us something special about the psychology 
(and neurology) of dogs will be left for the reader to decide But this much is 
clear if human words were tape recorded and the experiment repeated with prop- 
erly motivated parrots, myna birds, or children, imitative learning would be a 
foregone conclusion The writer’s best guess is that m the dog experiment we were 
working against a neurological defect or powerful instinctive mechanism of some 
sort Incidentally, the situation is made all the more puzzling by the fact that 
some house dogs are apparently able to bark (“speak”) on command (see foot- 
note 3), yet, as a supplement to the experiment in question, a professional dog 
trainer was unable to estabhsh such behavior in any of our subjects 
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IH The ''Autism'" Theory of Word Learning Restated 
and Extended 

The view that words are learned, by “talking” birds and by human 
infants, neither by trial and eiior noi by simple reflex conditioning, but 
by the mechanism outlined in the preceding section has been devel- 
oped, somewhat diffeiently and more fully, m a paper entitled “The 
Autism Theoiy of Speech Development and Some Clinical Applica- 
tions” (Mowier, 1952) A poition of that paper is reproduced below 

Recently there has emerged, as a deduction from learning theory and 
psychoanalysis, an hypothesis concerning normal speech acquisition which 
promises to have interesting applications in the field of speech pathology 

More particularly this hypothesis comes from an investigation which the 
author started some five years ago in an attempt to see what could be learned 
about language and its development in human beings from a study of the 
so-called talking birds From an analysis of such anecdotal literature as is 
available and our own observations with a small number of birds (including 
two parrots, a Mynah bird, two common crows, two Western magpies, and a 
number of Australian parakeets), it is apparent that birds learn to talk when 
and only when the human teacher becomes a love object for them This 
interpretation is consistent with expectations generated by the principle of 
secondary reinforcement (learning theory) and the principle of identifica- 
tion (psychoanalysis) 

Operationally, the first step m teaching a bird to talk is to make a “pet” 
of It, which is to say, tame, care for, and “baby” it in such a way as to 
deflect the interests and emotional attachments of the bird away from 
members of its own species to another species, namely ho 7 no sapiens This 
IS commonly done by isolating the bird from its own kind and making it 
dependent for food, water, and social attention and diversion upon its hu- 
man caretakers 

But there is another step involved which only a few species of birds — 
and apparently no mammal save man — can make As one cares for and 
plays with these creatures, one makes certain characteristic noises These 
may or may not be parts of conventional speech, any kind of a noise will 
do — be It a word or phrase, a whistled or sung fragment of a tune, a non- 
sense vocalization, or even a mechanical sound like the creaking of a door 
or the opening of a food box — anything so long as it is intimately and con- 
sistently associated with the trainer and his care-taking activities As a result 
of the association of these sounds wuth basic satisfactions for the bird, they 
become positively conditioned, 1 e , they become good sounds^ and in the 
course of its own, at first largely random vocalizations, the bird will even- 
tually make somewhat similar sounds By the principle of generalization, 
some of the derived satisfaction or pleasure which has become attached to 
the trainer’s sounds wall now be experienced when the bird itself makes and 
hears like sounds, and when this begins to happen the stage is set for the 
bird’s learning to ‘talk ’ 
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In terms of learning theory, what has happened is that initially neutral 
sounds, by -virtue of their occurrence in temporal contiguity with primary 
reinforcements, have acquired secondary reinforcing properties When the 
bird Itself happens to make somewhat similar sounds, it is now secondarily 
rewarded for havmg done so and tries to perfect these sounds so as to make 
them match as exactly as possible the original sounds, and thus derive from 
them the maximum of pleasure and comfort 

In terms of psychoanalytic theory, the bird, as a result of developing 
“positive cathexis’"’ (love) for its human trainer, or “foster parent,” identifies 
with and tries to be like that person Birds cannot do much by way of 
making themselves look like human beings, and even if they could they 
would not ordinarily enjoy this resemblance [since they could not usually 
see themselves], but they can make themselves sound like human beings, 
and this they do, under the conditions indicated, with evident satisfaction 

Once words, phrases, whistles, snatches of song, or other distinctively 
human sounds have been perfected on the autistic or self-satisfaction basis 
just described, these same responses can, of course, be employed socially 
or communicatively Birds that have learned human sounds on an autistic 
basis can later use these sounds mstrumentally, as a means of indicating 
some desire or need or perhaps just as a device for assembling and 
holding an admiring and reassuring audience But the essential first step 
in this developmental sequence, m the author’s belief, is one in which the 
reproduction and perfection of human sounds occur, not because of their 
objective utility, but because of the subpctwe comfort and satisfaction they 
provide 

So far as can be determined at present, essentially the same account holds, 
at least up to a point, for acquisition of speech by human infants Words 
or other human sounds are first made by infants, it seems, because the 
words have been associated with relief and other satisfactions and, as a 
result, have themselves come to sound good Human infants, like birds, 
are vocally versatile creatures and in the course of random activities in 
this area will eventually make sounds somewhat similar to those which have 
already acquired pleasant connotations and will, for reasons indicated, have 
a special mcentive for trying to repeat and refine these sounds 

Soon, however, the infant discovers that the making of these sounds can 
be used not only to comfort, reassure, and satisfy himself directly but also 
to interest, satisfy, and control mother, father, and others® Up to this 

®One may thus say that words are first reproduced by infants, when parents 
are not immediately available, as a means of recapturing some of the pleasures which 
parents ha\e previously provided In a very primitive and rudimentary sense, thev 
are trying to re-present the mother, le, make her present again, in an autistic, 
quasi-magical way This they do, not with a conventional word for her, but with 
her sounds But then, as the infant thus learns to make conventional word sounds, 
the second stage of word functioning emerges Now he utters a specifically mean- 
ingful word which serves, literally, to re-present the mother, recall, recapture, 
recreate her, and in so doing the infant reduces the necessity for relying upon the 
autistic, self-supplied satisfactions Now, instead of merely playing with words, 
the mfant makes them work It is well known that small children who have “re- 
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point the speech learning of birds and babies seems to be virtually identical, 
but before long, somewhere around i8 months or two years of age, human 
infants begin to do something of which birds, even the most talented of 
them, are incapable It is always a big event for the rest of the family (and 
probably for the baby, too') when a baby begins to “put words together,” 

1 e , to make original, functional sentences Birds may learn to repeat, “parrot 
fashion,” phrases, sentences, or even longer sequences of human speech but 
the indications are that these are never understood and used by birds with 
their full import and meaning As De Laguna (1927) has remarked, predica- 
tion IS the thing that gives language at the human level its most distinctive 
quality, and it seems that this is never achieved by mfrahuman organisms 
(pp 263-265) [see Chapter 4, also a series of papers on language and “per- 
sonality” as they appear in Newcomb & Hartley, 1947] 

Saying that one must first make a “pet” of a bird (or a baby) in 
ordei to pi o vide the conditions necessary for the development of 
words IS not, of course, the same as saying that it should be “spoiled ” 
The wiiter once received a letter from a woman who owned a myna 
bird which was thoroughly “loved” in the sense of being indulged, 
but still It would not talk From details supplied in the letter, it was 
apparent that the bird nevei knew a moment of want it had a constant 
supply of water and preferred food and was even taken to work by its 
owner rather than being left alone The reason, obviously, why the 
bird did not talk was that, since it was never allowed to want for 
anything, its mistress could not reward it and, as a result, was unable to 
cause her utterances to take on potency On advice, the bird’s mis- 
tress changed the regime and wrote, in less than two weeks, to say that 
the bud had staited to talk He had, figuiatively speaking, learned to 
“say Uncle ” But the lady added (facetiously) that, although the bird 
was learning to talk, the training pioceduie was so hard on her that she 
didn’t know how much longer she would be able to keep it up 

IV Autism Theory Applied Clinically 

The theoiy of word learning outlined in the pieceding sections of 
this chapter is suppoited (a) by the fact that it is simply a special case 
of a broader set of principles and (b) by empirical evidence derived 
fiom the obseivation of woid learning by birds and babies Still further 

sponsive” and “attentive” parents do not rely upon fantasy (and other forms of 
autistic behavior) so extensively and protractedly as do neglected children Here 
as elsewhere, it seems that good parenthood imolves a judicious balance between 
indulgence and deprivation If the child ne\er wants for anything, he lacks motiva- 
tion for speaking, but if he speaks and no one responds, this too can deter normal 
language development 
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credence is given to the theory by the success reported in the following 
paragraphs (Mowrer, 1952) in making clinical application thereof 

Two years ago a young woman reported that tests had recently confirmed 
what she and her husband had suspected for some time, namely that their 
two-year-old daughter was very hard of hearing and that as a result her 
language development was being seriously retarded In fact, the child had 
no real words and showed no interest in and refused to wear a hearing aid 
The mother was convinced that the little girl had so??2e hearing, as evidenced 
by the fact that if she were engaged in some forbidden activity and the 
mother shouted “No,” the child, even though her back was turned to the 
mother, would respond 

It was apparent from these meager facts that the only sounds that were 
getting through to this child were “bad” sounds, and one could conjecture 
that the less often she heard them the better it suited her There was, m 
short, no “appetite” for the vocalizations of others and consequently no de- 
sire to make similar sounds herself 

When the situation was interpreted to the mother in these terms, she 
quickly consented to a regime m which vocalizations would not be used for 
disciplinary purposes at all but would instead be associated as often and 
as deliberately as possible with agreeable experiences Ordinarily one an- 
nounces pleasant events in a soft tone of voice reserving the raised voice 
for warnings and condemnations The prescribed plan thus called for a 
reversal of the usual situation The mother was able to carry through, how- 
ever, and very quickly the child became interested in words, was soon 
willing to tolerate a hearing aid so that she would be more clearly aware 
of them, and within six months was herself effectively making and using 
quite a number of words 

More recent follow-up data are not available on this case, nor has there 
been opportunity to test this type of thinking systematicall\% with a sta- 
tisticallv meanmgful number of cases One case can serve as well as manv, 
however, to illustrate a remedial procedure and the rationale behind it 
Other investigators, with more numerous cases of a similar kind at their 
disposal, may be able to validate the procedure Even though the theorv 
be entirely correct, one cannot of course, expect success in all instances 
The method’s effectiveness presupposes, above all else, parents — and in par- 
ticular a mother — ^who can and will make the indicated changes in vocal 
habits Not all parents have the requisite degree of flexibility and motivation 
to accomplish this end, but it seems likely that the demands which the 
method places upon parents will usually be acceptable, and in such cases 
the method, given other favorable circumstances, should work as well as 
in the case described 

Sanger (1955), in an unpublished study directed by the author, observed 
the relationships of a number of mothers and their infants over a period of 

" Since the above was written, the author chanced to meet the little girl’s father 

in another city He reported that “L is chattering like a magpie now In fact, 

if anything, she talks too much — ^we can’t answer all her questions ” And informal 
reports from speech clinics indicate that the method is working out well in other 
cases (cf Rigrodsky, 1958, Morkovin, i960) 
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many months, with special reference to the role of vocalization by mother 
and by infant One of the first things discovered was that most mothers 
— and particularly those who, by other criteria, seemed to be the good 
mothers — kept their infants “bathed in sound” most of their waking hours 
While caring for their infants or just spending leisure time with them, 
these mothers vocalized almost continuously, and even when other duties 
took them to adjoining rooms, they would commonly sing or call to the 
baby intermittently (cf Rheingold, Gewirtz, & Ross, 1959) 

This pattern of behavior is well calculated to make the mother’s voice 
a welcome and reassuring sound, and it seems probable that much of the 
motivation for the babbling and cooing that mfants normally engage in 
stems from the fact that the human voice, by virtue of the circumstances 
just described, has taken on pleasurable (secondary reinforcing) prop- 
erties Although baby’s voice does not sound exactly like mother’s voice, 
the similarity will usually be sufficient to cause a carry-over of some of 
the pleasurable qualities of one to the other, and we may surmise that the 
production of mother-like sounds, in the form of babblmg, is a first and 
highly useful step in the child’s progression toward fully articulate speech ^ 

The fact that congenitally deaf babies babble very little, if any, and do 
not, without highly specialized instruction, learn to talk at all indicates 
how crucial is the capacity to hear and inwardly enjoy first the pleasant, 
reassuring voices of others and then one’s own somewhat similar sounds 
Although congenitally deaf children usually have completely normal voice 
organs and although their parents would only too gladly reward them [m 
keepmg with the trial-and-error learning principles] for using these organs 
to make word-hke noises, the fact that such responses, because of the deaf- 
ness, are not autistically satisfymg to the child is a crucial handicap 

It is usually only after a normal infant has had many months of experi- 
ence with the mother’s voice as a good sound that he begins to hear it, on 
occasion, with implications of warning and threat That this is an unwel- 
come development is dramatically mdicated by the fact that when parents 
are scolding or admonishing them, small children will sometimes be seen 
to put their fingers in their ears, thus shutting out the now distmctly un- 
welcome human voice But ordinarily, by the time parents begin to dis- 
cipline their offspring by means of speech, the speech-learning process will 
have already gamed sufficient momentum to be able to withstand the shock 
of this negative use of voice, and the impact of this disciphne, however 
else it may be reflected, almost never has a permanently harmful effect 
upon language functions ® 

® Because a woman’s voice is more like that of an infant or small child than is 
a man’s voice, it is probably more efficient for women to have primary respon- 
sibility for the verbal development of children than it would be for men to have 
this responsibihty 

®So many different guesses have already been made about the possible cause (s) 
of stuttering that another, equally questionable one, cannot be objected to Con- 
ceivably, in some instances, the trouble arises from a conflict between wishing 
and not wishing to hear one’s own voice This might arise, through generalization, 
from a strong ambivalence toward the voices of others Or, where the stutterer 
himself feels chronically guilty about somethmg, the conflict could arise from the 
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When, however, the gentle, loving sounds which good mothers make to 
their infants have been missed, due to hearing defects, and when the first 
human sounds to get through to the child are shouts of displeasure and 
proscription, it is almost axiomatic that the child thus handicapped will not 
want to hear, will not want to use even that small portion of his hearing 
equipment which may still be functional When this abnormal course of 
events has occurred, the theory here explored would dictate the corrective 
procedure already described, and with reasonably favorable attending cir- 
cumstances, one should expect results comparable to those obtained in the 
case reported (pp 266-268) 

It IS an interesting and instructive circumstance that infants who 
are born totally deaf do not babble^ or do so very little In teims of our 
present thinking, there aie two reasons for this, the first being that, 
since such children are unable to hear the sounds which others make 
in rewarding contexts, there is no secondary reinforcement to gen- 
erahze to their own vocalizations (Mowrer, 1950, Chapter 24) But, 
as indicated in a preliminary way in Chapter 7 of Learning Theory and 
Behavior and more fully in Chapter 7 of this book, it is also probable 
that so-called voluntary control (or initiation) of a response is con- 
tingent upon sensory feedback therefrom, and since the major and, by 
all odds, most discriminating awareness of vocal responses is normally 
through the ear^ it is hkely that the control, as well as motivation, of 
these responses is seriously impaired There is clearly an important 
relationship between the type of theory under consideration and prac- 
tical methods of teaching the deaf (see, for example, Silverman, 1954, 
Fairbanks, 1954, and Dicarlo, 1958) 

Somewhat parenthetically, it is also interesting to note how nearly 
identical the sensory consequences of vocalization are (in normal in- 
dividuals) foi both the speaker and the hearer Actually, of course, 

self-accusatory— or self-revealing — potentialities of his own voice For somewhat 
related thoughts about this problem, see Wischner (1952a, 1953b), Goss (1952), 
Sheehan (1953), and Sheehan & Voas (1954) 

One other brief word needs to be said about the business of babbling Com- 
monly It IS said to be a prelude to or precursor of speech In a certain sense, it 
IS Speech, 1 e , an imitation of the undifferentiated voice sounds which the infant 
constantly hears around him Young parakeets, before beginning to say separate 
and distinct words, often engage in what is called “little bird talk,” namely a kind 
of babble or jabbering, and parrots, even after they learn to say definite words 
or phrases, will sometimes give an astonishingly good imitation of the conglomerate 
sound of voices in a roomful of people A mixture of distinct words and babble 
occurs in this sequence of utterances which a neighbor’s Myna bird often engages 
in “Hel-loo Jabber, jabber, jabber Jabber, jabber, jabber Ha, ha, 
ha, ha hah’ Jabber, jabber, jabber Good-bye’” The original model for this 
performance is not hard to identify 
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both are “hearers,” and v)hat they hear differs only in minor ways 
(which become apparent when one hears one’s voice in recorded 
form, rather than directly) In most forms of behavior, kinesthesis is 
the principal sensory result — ^which, of course, can be perceived only 
by the performer — ^i e , only he knows what he is “doing ” Only when 
a (nonvocal) action can be see% both by performer and by others, do 
we begin to approximate the special conditions required for language, 
and even here what the performer sees (and the angle from which he 
sees It) IS considerably different from what another person sees (see 
next section for further discussion of gesturing) Only by watching 
himself in a mirror or some other “reflecting” surface can the per- 
former get a “feedback” which closely approximates the pattern of 
visual stimulation reaching others But there is another means, which 
has been of enormous historical importance, of achieving much the 
same end If a person moves a hand (or foot) in such a way as to leave 
a mark on something, what others see when they exchange places with 
the mark-maker is exactly the same And it is this simple and impor- 
tant fact which has made possible that other, nonvocal form of language 
which we call njoriting How extensively this form of commumca- 
tion is utilized and cultivated m the education of the deaf, as a sub- 
stitute for or an adjunct to speech is, of course, well known (Mykle- 
bust & Bruttan, 1953) But it is also known how extremely difficult the 
establishment of language is where hearing and sight are both absent 
Here touch becomes the principal medium, or mediator, of learning, 
but It IS not nearly so satisfactory and eflicient as either hearing or see- 
ing (see Keller, 1902) 

An objection to the autism theory of language learning is sometimes 
raised on the grounds that it cannot explain how infants learn to utter 
and use negative words If words are reproduced because their original 
pronunciation by others occurs in the context of pleasure and gratifica- 
tion, how. It IS asked, can one explain the fact that infants also learn 
to say “No” and to reproduce other forbidding, negative, ^pleasant 
words^ Such an objection is easily answered We begin with the 
observation, and ready admission, that if the only words which an 
infant hears are negative (fear arousing, frustrating) ones, then he will 
indeed not learn to speak, as the case of the little girl cited above 
clearly indicates But in the normal situation, the infant has relatively 
enormous experience with human sounds (especially those uttered by 
the mother) in all kinds of positively reinforcing contexts, long before 
there is any negative use of voice, and on the basis of the word re- 
sponses which are thus learned (on an autistic basis), the child soon 
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discovers the great practical utility of words, as a means of instru- 
mental and social control, with ensuing reinforcements which are 
no longer merely autistic Therefore, by the age of two or three the 
child sees what a “good thing” language is and actively works at get- 
ting more of it and is now able, and strongly disposed, to reproduce 
words “voluntarily” (in much the same way that he makes other 
overt responses), if it suits his purposes to do so Just as an adult 
can (within limits) deliberately repeat a heard vocal sound if he wishes, 
so may a child, after the basis for language has been laid, autistically 
In other words, if a child sees that other children (or adults) can pro- 
tect themselves or otherwise control a situation by uttering the word, 
“No’”, there is no reason to suppose that such a response has to be 
learned on the original, primitive autistic basis 

And, more than this, negative, prohibitive terms are often used by 
a child in the management of his own behavior Not infrequently 
youngsters, when in a conflict situation (i e , when tempted to do some- 
thing for which they have previously been scolded or punished), are 
heard to say, “No, no’ Johnny mustn’t do that ” Thus, once language 
IS fairly launched (by the autistic mechanism), we see that there can 
be quite powerful incentives and reinforcements for utterance of the 
so-called negative words and that this fact is in no way at variance 
with our assumption about the mechamsm underlying the earlier, more 
fundamental stage of word learmng (cf Mowrer, 1958) 

V. The Origin of Language, with Special Reference to Gesturing 

During the eighteenth and mneteenth centuries the Societe Linguis- 
ttque received so many commumcations on “the origin of language” that, 
some 75 years ago, it put a ban upon further papers on this topic The 
difiiculty, of course, was that there is no very good way to check 
speculation against the historic — or, more precisely, the prehistoric 
— facts Writing is our oldest means of recording speech, and its inven- 
tion dates back only about six thousand years, whereas the tiue be- 
ginmngs of human language probably go back to the Stone Age, 
80,000 to 100,000 years ago (Bodmer, 1944, Stewart, 1946) Admittedly, 
the methods available for disciplimng, much less crucially confirming, 
speculation along these lines are poor, yet the problem is a fascinating 
one and warrants our asking if the autism theory of word learning, as 
It applies in a social group already possessing language, can throw any 
light upon how man probably started using certain sounds as words 
rather than other equally possible ones 
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In a book called Man and His Works, by E L Thorndike (1943), 
there is a delightful chapter entitled, “The Origin of Language,” which 
gives a quite excellent summary of the various theories which have 
attracted most interest and credence in this connection With certain 
unimportant omissions, this summary follows 

We must first glance at thiee time-honored and then dishonored theories, 
now known by these opprobrious names ding-dong theory, bow-wow 
theory, and pooh-pooh theory 

The ding-dong theory assumed a mystical power of certain things to 
evoke certain sounds from men Smce each such sound was associated with 
the experience of the thing, it came to mean it And since men were alike 
m their responses to things by sounds, one of these sounds meant more or 
less the same thing to all m the group, and easily became a vehicle of com- 
munication All the evidence is against the existence of any such mystical 
power, and only extremely strong evidence would induce any scientific 
student of psychology or of language to put any faith in so extremely un- 
likely an origin of language (pp 84-85) 

Implicit m the ding-dong theory, as Thorndike describes it, is the 
notion of conditiomng in its classical guise the direct “experience of 
the thing” is the UnCS and produces a reflexive vocal reaction of some 
sort in the subject, and since we often see things before they impinge 
upon us, the sight thereof would serve as a CS and elicit the same reac- 
tion, which, as a conditioned response, could now serve the function 
of indicating or na 77 img Although our reasons are not precisely the 
same as Thorndike’s, we can quickly agree with him that this is not a 
very plausible hypothesis This wiiter goes on to say 

The bow-wow theory supposed that men formed habits of using the 
sounds made by animals, things, or events to mean the respective animals, 
things, and events, and that these habits started them on the road to in- 
ventmg other sounds as signs of animals, thmgs or events Foi various 
reasons this theory is disci edited Doubtless after man has language he 
will often make the sounds that animals and things make, but it is doubtful 
how often he will do so in a languageless group Possibly he will do so only 
accidentally as a part of his general vocal play There might be little agree- 
ment m the ideas evoked in the members of a human group by hearing 
the varying sounds which its various members made when they thought of 
a dog, a cow, thunder, and the like (p 85) 

Actually, as we shall see presently, there is much to recommend the 
bow-wow theory, and Thorndike summarily rejected it, it seems, less 
from lack of evidence than from the inability of his own theory of 

^^More recent treatments of the same topic may be found in Cassirer (1944), 
Pumphrey (1951), and Estrich & Sperber (1952) 
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learning to account for it, zf true But we should get Thorndike’s argu- 
ment more fully before us before entering our objections in detail 

The pooh-pooh theory, or interjectional theory, supposed that the in- 
stinctive unlearned cries of man as a wordless animal, which already are 
sounds that are evoked by certam situations and evoked in human hearers 
certain equally unlearned responses of action and feeling, came to possess 
meanings also, and that on the basis of this vocabulary of familiar sounds 
meaning pam, surprise, fear, affection, and the like, early man here and 
there used other sounds to mean other facts 

Nobody should doubt that part of this is true To a mother whose baby 
cries and seeks her breast that cry probably means that the baby wants to 
be fed if anything means anything to her If she can think of anything 
she will think of that, as well as react appropriately to it But for various 
reasons students of language have decided that the attachment of meanings 
to the hearmg or the making of these sounds of instmctive nature is not 
adequate to origmate articulate speech So-called animal language plus the 
power of thinking meanings would not produce human language 

An mgenious theory has been set forth by Str Richard Paget, a physicist 
and student of phonetics, who argues that the total behavior of a man to a 
situation includes characteristic movements of the tongue and lips and other 
organs of speech These gestures of the mouth parts became specially im- 
portant when a man’s hands were “in contmual use for craftsmanship, 
the chase, and the beginnmgs of art and literature,” so that he could not 
gesture with them Sounds were added to these “mouthings,” and finally 
came to play the leadmg role (pp 84-87) 

Paget’s book (Human Speech) is so recent (1930) that his theory has 
not yet received a pet name Using the first illustration that he gives we 
might call It the yum-yum theory This, however, really misrepresents and 
unduly favors it, for the theory requires the mouth parts to pantomime 
not eatmg, drmkmg, sipping, blowing, and other acts of the mouth parts 
themselves (nobody doubts that), but movements of other parts of the 
body A truer nick-name would be the “tongue-tied” theory, meaning that 
the tongue is yoked with the body by subtle bonds of mimetic kinship 
The theory has been accepted by at least one psychologist, Eisenson, but 
It has not been accepted generally Personally, I do not believe that any 
human bemg before Sir Richard Paget ever made any considerable number 
of gestures with his mouth parts m sympathetic pantomime with gestures 
of his hands, arms, and legs, still less that any considerable number of men 
m any local community made the same oral gestures in such pantomime 
(P 90) 

Although It IS something of a digression, there is more that can and 
probably should be said here about the relation of gesture to both lan- 
guage and learmng theory In another paper (Mowrer, 1954), to which 
repeated reference will subsequently be made, this problem has been 
analyzed as follows 
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One aspect of the problem of the origin of words which is of special 
interest here has to do with the tendency, under favorable conditions, for 
instrumental acts, or ‘^habits,” to become foreshortened into mere behavior 
tokens, or “gestures ” I shall always remember the following experience with 
the little girl mentioned earlier in this paper Havmg learned to sit alone 
on the floor when about six months of age, she would occasionally cry to 
be picked up, and often, in anticipation of such action on the part of her 
parents, she would hold up her arms flexed m preparation for bemg lifted 
One day she was seen looking hopefully in the direction of her father, arms 
flexed, but not crying She was picked up, and her mother’s cooperation 
was elicited in seeing what would happen if we let this gesture replace 
crymg as a signal for being taken up Being more effortful, apparently, 
the crymg quickly gave way to the arm flexing, and, then, this response 
Itself underwent further mvolution Soon the little girl was lifting only 
her right arm, and finally she would just hold up the right hand or fore- 
finger 

The tendency for actions which an experimenter has arbitrarily defined 
as “correct” in a problem-solving situation to deteriorate has been com- 
mented on by various writers As early as 1898, Thorndike, having taught 
cats and dogs to lick or scratch themselves as a means of getting out of a 
problem box, remarked “There is in all these cases a noticeable tendency, 
of the cause of which I am ignorant, to dimmish the act until it becomes a 
mere vestige of a lick or scratch” (p 28) And some forty years later, 
Lorge (1936), havmg performed a similar type of experiment, wrote 

“In addition to reducing the time required to make these responses fol- 
lowed by rewards irrelevant to them, the animals short-circmted these 
responses With successive trials, the responses became more perfunctory 
and stereotyped The ‘face-washmg’ changed from a vigorous wash to a 
rapid movement of both forelegs to the face, the ‘scratch’ changed to a 
rapid flexion of the hmd-leg to the flank, only remotely remmiscent of the 
first response to irritation” (p no) 

This “stram toward inertia,” a phrase used by Sumner, Keller, and Davie 
(1928), or tendency toward economy of effort can be observed to special 
advantage under the circumstances shown m the following motion picture 
(Movie) Here we see how readily an initially complete instrumental re- 
sponse, involving a rat’s going about two feet from a food trough to push 
a Skmner bar and then returning thereto for the food thus produced, will, 
if given an opportunity, deteriorate, first m the sense of the bar pressing 
turning into mere bar touching, then the rat will begin runnmg well down 
toward the bar but turning around and going back to the trough without 
touching the bar, then these “loops” are seen to get shorter and shorter, 
until, finally, the rat, after finishing a pellet of food, will simply move 
his head around and “look” m the direction of the bar Thus, he may be 
said merely to “give us the nod” to mdicate his wish for another pellet 

It goes without saying that m order for gesturing to replace fully in- 
strumental behavior, there must be, somewhere in the situation, a second 
organism which is able and willing to do some of the first organism’s work 
for It, on the basis of a mere sign or “command ” In the present instance, 
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this second organism was the experimenter, who took over the function of 
activating the food delivery mechamsm which had previously been done by 
the rat’s bar pressing Thus, what was originally a fully mstrumental action, 
mvolvmg only the rat and the physical world, was changed into a social 
situatio7i and what was originally an instrumental act became a social art 
mvohing, mmimally, two organisms 

The protracted helplessness of the human infant and the necessity for 
the mother to display, in response to signs, what Courtney (1949) has called 
mediating behavior creates a strong natural predisposition for human be- 
ings to be inveterate sign users Because of this long period of dependence 
and indulgence, perhaps it is not too much to suppose that we spend a good 
deal of the remainder of our lives trying, by means of signs, to get others to 
do things for us or, at least, cooperate with us Infantile helplessness very 
likely gave the human race one of its most powerful pushes toward both 
language and sociality, generally speaking 

The Law of Least Action, as Wheeler (1929) called it, which we have 
seen exemplified in the foregoing discussion, is a very pervasive behavior 
prmciple, whose special applications in certain areas of language have been 
documented m detail by Zipf (1949) However, it has a major limitation 
with respect to our present concern We find that the signs most com- 
monly employed in human communication are not gestures, which are 
visually transmitted, but rather the particular noises we call words And 
since a great many instrumental actions are essentially silent to begin with, 
we cannot very plausibly look upon words as condensations, or fore- 
shortened versions, of originally fully instrumental, nonsocial behaviors 

“ The writer also recalls the development of an interesting gesture on the part 
of a myna bird When offered food, this bird was sometimes not able to determine 
if she liked it or not merely from its appearance, so would take it into her mouth 
and taste it If she did not hke it, she would then shake her beak vigorously back 
and forth m order to eject the food On numerous occasions it was observed that 
when this myna was offered food previously found objectionable, she would 
shake her head as if the food were m her mouth Here we see perhaps an ancient 
historical root of the corresponding human gesture of negation Cf Darwin 
(1873), Wolff (1945), F H Allport (1924, p 179) 

“Perhaps the most elaborate visual sign and gesture language known m his- 
torical times was the Lingua franca of the American Indians In comparison with 
any known spoken language it was, however, apparently very awkward and in- 
efficient 

“ At the risk of overcomplicating an argument which is already far from simple, 
the writer is tempted to inject the followmg thought at this point Granted that 
words probably did not stem directly from the foreshortened instrumental acts 
which we call gestures, there is still a sense in which language is a substitute for 
grosser, more effortful action In fact, one of the powerfully reinforcing things 
about language is that it so often, and so effectively, saves us trouble, the trouble 
of going somewhere else and doing something ourselves which another person, 
who IS already there, can more economically do for us (Being “somewhere else” 
may be interpreted either geographically or in terms of special skills which only 
a few acquire because of the “long road” of experience and learning that is invoked 
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Some words may very well have originated as copies of sounds associated 
with particular actions, as, for example, the word, “patter,” to represent or 
suggest running But even here the responses involved in saying “patter” 
have nothing in common with the responses involved in actually “pattering,” 
so even m this case we must look for a different principle (pp 676-678) 

The theoiy of the origin of language which Thorndike, m the chap- 
ter already cited, himself advanced is intricate and, to this writer, 
improbable, so no attempt will be made to describe it m detail It in- 
volves, as one might expect, basically a trial-and-error procedure (see 
p 72), but Thorndike recognizes some of the difficulties inherent in 
such an approach and makes the following summarizing, as well as 
somewhat deprecatory, statement 

It IS perhaps time to attach a name to the theory I am expounding Let 
us save everybody trouble by giving it an opprobrious name from the 
start’ Smce it relies on the miscellaneous vocal play of man mstead of his 
alleged mimetic or emotional utterances, it could be called the “babble- 
babble” theory Since it starts with languages private to single persons, and 
progresses gradually toward speech m the full speaker- hearer relation 
(which, mdeed, my exposition has not yet reached) it could be called the 
“onety-two” theory Since it depends on successive selections of chance 
variations in sound-reality connections, it could be called the “chancy- 
chance” or “luck-luck” theory Or we may combine its two mam dynamic 
features and call it the “babble-luck” theory (p 97) 

Thorndike extrapolated this theory into an explanation of how, in 
his opimon, an infant, born into a society which already has words, 
learns those words In the course of its random vocalizations, the young 
child has the luck to make a sound that is recognizably like some ac- 
cepted word, reward, from mother or some other person, follows, and 

m mastering them ) When we think of how much “lost motion” is thus avoided, 
1 e , how much more we can accomphsh (“get out of life”) if we are “in contact” 
with others at more or less remote points m space (or who have specialized skills) 
than we could if we had to “go and do” everything for ourselves, the implications 
of language become almost overwhelming, and we see, especially clearly, how 
intimate and indispensable a role it plays in creating and perpetuaung what we 
call society^ or “sociality,” both transversely and longitudinally, through space 
and through time These remarks will recall what has already been said and, at 
the same time, indicate that there is at least a superficial mconsistency between 
the conception of language as a means of social coordinauon and control and the 
view, more especially stressed m this paper, that the mam function of the sentence 
IS to produce second-order conditioning in others, which will then be generalized 
to the referent, or significate, of the sentence subject In the one case we are 
primarily interested in '‘'‘getting action'^ and, m the other, in giving information 
How these two aspects of language process, both of which seem real enough, are 
systematically related invites independent consideration (Chapter 4) 
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the likelihood of this sound’s subsequent occurrence is gradually in- 
creased This, of course, is strictly in keeping with Thorndike’s con- 
ception of learning by doing Or, should it be said that, having arrived 
at this conception of word learning from his general theory of learn- 
ing, Thorndike then constructed the foregoing notion of how lan- 
guage originated, in the history of the race!" In any case, Thorndike’s 
views on both language origin and individual language learning were 
consistent with (and probably dictated by) his over-all notions about 
the learning process Already we have examined the quite different 
view of word learmng to which our own conception of learning in 
general leads, and in the section which follows we shall consider that 
theory of language origination which is most congruent therewith 

“Of the making of theories concemmg language origin there seems to be no 
end Since the foregomg section was written, Bixler & Yeager (1958) have pub- 
lished yet another one Their paper, entitled “It May Have Begun with ‘Mama’,” 
notes the well mgh umversal use of “mama” (or some variant thereof) as the 
small child’s name for its mother The authors say “Our proposal may be stated 
as follows The earliest vocahzed syllables associated with discomfort, especially 
hunger, consist of variations of ‘ma ma ma muh ’ At the time speech would have 
originated it seems likely that only the mother could have relieved hunger pangs 
Thus the cry, ‘ma, ma ma muh,’ when it occurred was followed most frequently 
all over the world by the mother relievmg the child’s distress and, m turn, gaming 
relief from distention of her breast At this point either or, more likely, both 
mother and child could learn (become ‘operantly conditioned’ to) the sound ‘ma 
ma’ in some variation as designating the mother Support for this idea is found in 
the observations of Gesell & Amatruda (1947) and Lewis (1948), the apparent 
universality of ‘ma ma’ as an infant designation of mother, and Skinner’s (1957) 
research m operant conditioning” (p 474) Although the ubiquity of “mama” is 
indeed impressive, the theory is somewhat less so This foomote is being written 
on a tram, and a few seats removed is a crymg mfant What the writer seems to 
hear is predominantly “wa wa” and “owh owh,” and he cannot recall ever hear- 
ing an mfant (prior to the onset of conventional language development) cry with 
the syllables “ma ma ma ” Perhaps a more hkely surmise would be that the mouth 
movements mvolved in saying “ma ma” (and perhaps “pa pa” as well) get rein- 
forced m process of nursing and thus, when phonated, produce the familiar sounds 
Even if the Bixler-Yeager thesis were valid as regards “mama,” it could hardly 
be expanded mto a general theory of word acqmsition, either m the race or the 
individual That is our objective 

“Cf also Skinner’s (1958a) conception of response “shaping” by the judicious 
use of reward for successively closer and closer “approximations” of the required 
act This procedure works well enough m some situations, but it would be 
manifestly inefficient m teaching a myna bird to say, for example, “How are 
you todays” In fact, one may reasonably doubt that it would be even remotely 
effective here (cf Skinner, 1957) 



LANGUAGE LEARNING AND IMITATION 


93 


VI The Bow-Wow (Onomotopoetic) Theory and Autism 
Theory Compared 

After the foregoing survey of various theories of language origin, wq 
are in a position to ask Wluch of these theories, if any, is most con- 
gruent with, and would be most favored by, the psychological prin- 
ciples (of learning and language) which have been thus far enunciated 
in this book^ In the paper already cited (Mowrer, 1954), an attempt 
has been made to answer this question, thus 

Of the various classical theories of word origination, the one most closelv 
related to this scheme is obviously the “onomatopoetic” or so-called “bow- 
wow” theory This conception of word genesis can be illustrated in a crude 
but probably valid way as follows Suppose that just before or as we give 
a laboratory rat a bit of food, we sound a tone of standard pitch and in- 
tensity This tone, as we know from numerous studies, will take on secondary 
reinforcing properties And if the rat could, with its own vocal cords, 
make a noise reasonably like the tone, we would predict, on the basis of 
principles already cited, that it would soon begin to do so Unhappily, in 
view of the severe limitations on vocalization in the rat which have already 
been mentioned, we cannot expect this to happen However, if we place 
the electronic oscillator used by the experimenter m producing the tone 
at the disposal of the rat, on the basis of movements which the rat can 
easily make, we should not be in the least surprised if the rat, under these 
circumstances, is disposed to “make” the sound So let us, after the rat is 
well trained with respect to tone associated with food, make a Skinner 
bar available, depression of which will have the same effect, with respect 
to producing the tone, as the telegraph key previously used by the experi- 
menter [Fig 3-1] shows the behavior of a hungry rat toward such a bar 
during a 20-minute period, m the course of which bar pressing produced 
no food but the “promise” of it, in the form of the tone and the secondary 
reinforcement it had acquired from prior pairmgs with food (p 679) 

This experiment is reminiscent of the Skinner procedure (pre- 
viously described) for getting a rat to make a particular (bar-pressing) 
response But we are here not so much concerned with the subject’s 
response per se as with the stimidation (sound) which the response 
produces In other woids, our fiame of reference is different instead 
of being interested in the direct utility (to the rat) of the bar pressing, 
we are concerned with its effectiveness in signaling to another or- 
ganism 

How energetically a rat, tramed m the manner just described, will con- 
tinue usmg the tone as a signal to the experimenter^ if the experimenter 
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will only cooperate, is suggested [in Fig 3-2] Here will be seen what 
happens if, when the rat pushes the bar and produces the tone, another 
organism responds to it as a sign that the rat wants food — and obliges 
A stimulus which was originally made by the environment to the rat is 
thus ‘‘taken over” by the rat and “made back” to the environment, and if 
another orgamsm will respond thereto, it becomes a “social act,” or true 
sign^® Of course, on the basis of trial-and-error learning alone, without 
the presence of a signal of any sort, a rat would eventually learn to press 
the bar if it produced food But the precipitous nature of the learning shown 
[m Fig 3-2] suggests, and experimentation reported elsewhere (Mowrer, 
1950, Chapter ii) confirms, that the intermediation of a stimulus with 
previously acquired secondary reinforcing properties produces a perform- 
ance markedly superior to what can be expected on the basis of trial and 
error alone (pp 679-680) 

Fig 3-1 Graphic record of 
bar pressing by rat, where this 
performance produced a tone 
which had been previously as- 
sociated with food The bar- 
pressing “habit” was thus 
learned solely on the basis of 
the secondary reinforcement 
provided by the tone As the 
secondary reinforcement ex- 
tinguished, the animal ceased 
to press the bar In this situa- 
tion the experimenter may be 
said first to have made the sig- 
nal to the rat as a means of in- 
dicating that It was going to 
get food The rat, when given 
an opportunity to push a bar 
which turned on the tone, 
made the signal “back” to the 
experimenter, but the experi- 
menter did not respond (cf 
Fig 3-2) 


The reader may be struck by a crude analogy between the performances shown 
in Figs 3-1 and 3-2 and the two stages of language development in the child as 
proposed by Piaget (1926) the “ego-centric” stage wherein the child “talks to 
himself,” and the stage of social commumcation, wherein the child talks to some- 
one else. 

^^A somewhat parallel instance is reported by Hollmgworth (1928) Having 
tramed a pet terrier to “sit-up” on command, with food as a reward, Hollmgworth 
observed that the dog was soon “sitting up” on its own mitiative, now not as an 
act of obedience but as a way of “beggmg,” 1 e , signalmg its desire for food 
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But perhaps the relationship of the foregoing discussion to the ono- 
matopoetic theory of language origin is still not fully apparent The 
tone, in the experimental situation described, may seem too “artificial” 
to suggest how natural sounds may have become the starting point for 
human language development The following quotation, taken from 
the same study, provides a partial answer 

A particularly rich source of sounds which might then be transformed 
into “words” are those which living organisms characteristically make during 
consummatory behavior of any kind [cf footnote 15] This possibility 
was called to the writer’s attention under the following circumstances A 
number of rats were being fed, seriatim (but at rather long intervals), in 
separate compartments so constructed that the rats could not see each other 
but could easily hear any noises which the other rats made The particular 
manner of feeding involved inserting food up into each animal’s compart- 
ment, “under its nose,” so to say, on the end of a small metal rod, between 


Fig 3-2 Graphic record of bar 
pressing by a rat where this per- 
formance produced a tone pre- 
viouslv associated with food and 
caused the experimenter to pro- 
vide food After se\eral trials, 
there was something like an “in- 
sight” (see upward inflection of 
curie at about 5 minutes) As 
the animal became satiated, to- 
ward the end of the recording, 
the rate of lespondmg declined 
In this lecord we see what hap- 
pens if an organism learns the 
meaning of a signal, is then per- 
mitted to make that signal, and 
some other organism responds 
appropriately thereto See text 
for discussion of possible bear- 
ing of this demonstration on 
the question of where human 
beings first got the noises they 
used as words and how infants 
learn to speak 
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the bars constituting the floor grill of the compartment While eating, the 
rat would hold the rod in its front paws and inadvertently “rattle” it 
against the grill bars Because this “rattling” — ^which itself sounds as if it 
might have had an onomatopoetic origin — accompanied eating, it became 
a “sign” to which the rats not having the rod responded with much interest 
and apparent anticipation It rather clearly had come to “mean” food, 
and one could imagine that in a comparable situation involving prehistoric 
men such a sound might well have supplied the model for some vocal re- 
production (p 679) 

In a course on the psychology of learmng, taught in the Summer 
Session of 1957 at the Umversity of Illinois, the writer was explaining 
the natural relationship between the autistic theory of word learmng 
and the onomatopoetic theory, and in the discussion which followed, a 
Turkish student, Mr Ahmet Enc, related the following story At one 
stage of World War I, French airplanes repeatedly bombed certain 
Turkish cities In order to do so they had, of course, to fly over open 
countryside, where they were a source of much interest to the peas- 
ants, who had never before seen airplanes and, indeed, had no name for 
them They were, however, soon christened “giigirs” — and the source 
of the word is obvious several old-style propellered planes, flying 
along together, make an unmistakable sound of “gir, gir, gir, gir ” And 
this word came into widespread usage, although there was already 
another word for airplane in the Turkish language, namely “Ucak ” 

Here, however, the sound from which the word was developed was 
a “bad,” rather than a good, one, and it might seem to go against 
our theory that such words develop, as well as words which aie predi- 
cated upon good sounds We conjecture that man, or protoman, was 
indeed first drawn into play with “words” because, by means of them, 
he could reproduce sounds which he liked to hear and that, in the be- 
ginmng, he was very careful not to reproduce bad sounds But later, 
when man had begun to discover the marvels of language, he became 
more venturesome and found that even “bad” sounds can have a good 
effect, when properly used (as will be more fully explained in Chap- 
ter 4, (cf also Section IV) 

We thus see that there is a good deal of support for the view that 
those natural sounds which, in the course of ordinary daily experience, 
had taken on secondary-reinforcement value for members of some pre- 

“Cf also the English-Amencan terms, “buzz-bomb” and “bazooka” For re- 
newed interest in and an experimental approach to the onomatopoetic theory of 
word origm, see Wissemann (1954), also Brown (1955) for an English review of 
this work Cassirer (1944) likewise gives the onomatopoetic theory considerable 
credence (pp 112-114) 
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histone human group probably provided the models, or prototypes, 
for those social sounds which we now call words There is, however, 
at least one superficial objection to this theory which remains to be 
mentioned, namely, the fact that different groups developed different 
languages, different vocabularies and sentence structures Assuming 
Nature to be uniform and her sounds and their significances to be rela- 
tively constant throughout the world, would we not expect, on the 
basis of the foregoing analysis, the emergence of a universal language, 
rather than the innumerable languages which actually exist 

There are two, rather obvious, rejoinders which can be made to 
this objection (i) It is, first of all, highly arbitrary to assume that 
human experiences, in widely separated and diverse parts of the world, 
are the same Pretty clearly, both the environment and man’s activities 
therein vary considerably with geography, hence, language variability, 
rather than umformity, would be the expectation (2) Moreover, in 
the preceding paragraphs we have been speaking only about the most 
primitive origins of words Once a human, or protohuman, group had 
discovered the magic of language from the use of a handful of words 
modeled upon natural sounds, it would almost inevitably come about, 
human ingenuity being what it is, that new words would then begin 
to be created, more or less ad hoc, and, in the course of time, these 
“artificial,” though no less useful or effective, words would numerically 
overshadow the onomatopoetic words and thus create a quite mislead- 
ing impression about “word origins ” The fact that a good many 
clearly onomatopoetic words are still found in various languages and 
that new ones continue to come into contemporary use every now and 
then certainly leaves considerable basis for supposing that onomato- 
poeia may, indeed, have provided the “start” for human language de- 
velopment, historically speaking 

VII The Problem of "Imitatlon^^ as Viewed by 
Thorndike 

As will now be clear, the analysis of language learmng (both in- 
dividual and racial) which is put forward in this chapter prominently 
emphasizes imitation Such an emphasis is, of course, far from new. 
But the difficulty commonly involved in earlier discussions of the prob- 
lem was that “imitation” was largely just a word, which carried po- 
tency only m the sense of explaining what its definition already im- 
plied Thus, word learning might be said to be “due to imitation,” and 
imitation would then be defined, by example, as a situation in which 
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one individual copies what another says or does It is, of course, the 
very fact of copying that calls for explanation, and it is believed that 
such explanation is achieved, in preceding sections, in a strictly non- 
circular manner In other words, it appears that we have evolved a 
genuine theoiy of imitation 

Although a considerable literature exists on the topic of imitation, 
no attempt will be made here to review it systematically Instead, ref- 
erence will be made to only three specimen treatments of the prob- 
lem, an early one by Thorndike and, in the following sections, recent 
ones by Miller & Dollard and by Hayes & Hayes In a monograph en- 
titled “Animal Intelligence” and published in 1898, Thorndike reports 
some highly cogent, but little-cited, observations He says 

To the question, “Do animals imitate^” science has uniformly answered, 
“Yes ” But so long as the question is left in this general form, no correct 
answer to it is possible It will be seen, from the results of numerous experi- 
ments soon to be described, that imitation of a certain sort is not possible 
for animals, and before entering upon that description it will be helpful 
to differentiate this matter of imitation into several varieties or aspects The 
presence of some sorts of imitation does not imply that of other sorts 

There are, to begin with, the well-known phenomena presented by the 
imitative birds The power is extended widely, ranging from the parrot who 
knows a hundred or more articulate sounds to the sparrow whom a patient 
shoemaker taught to get through a tune Now, if a bird really gets a sound 
in his mind from hearing it and sets out forthwith to imitate it, as mocking- 
birds are said to do, it is a mystery and deserves closest study If a bird, 
out of a lot of random noises that it makes, chooses those for repetition 
which are like sounds that he has heard, it is again a mystery why, though 
not as in the previous case a mystery how, he does it The important fact 
for our purpose is that, though the imitation of sounds is so habitual, there 
does not appear to be any marked general imitative tendency in these birds 
There is no proof that parrots do muscular acts from having seen other 
parrots do them But this should be studied At any rate, until we know 
what sort of sounds birds imitate, what circumstances or emotional atti- 
tudes these are connected with, how they learn them and, above all, 
whether there is in birds which repeat sounds any tendency to imitate 
in other lines, we cannot, it seems to me, connect these phenomena with 
anything found m the mammals or use them to advantage in a discussion 
of animal imitation as the forerunner of human In what follows they 
will be left out of account, will be regarded as a specialization removed 
from the general course of mental development, just as the feathers or 
right aortic arch of birds are particular specializations of no consequence 
for the physical development of mammals For us, henceforth, imitation 
will mean imitation mmus the phenomena of imitative birds (pp 47-48) 

Then follows a discussion of various commonplace phenomena which 
are usually regarded as “imitative” but which Thorndike was per- 
suaded were “indirect results of instinctive acts ” And, finally, he says 
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At any rate, whether previous authorities have agreed that such a process 
IS present or not, it is worth while to tackle the question, and the forma- 
tion of associations by imitation, if it occurs, is an important division of 
the formation of associations in general The experiments and their results 
may now be described (pp 47-50) 

According to Thorndike’s view and conviction, the upshot of these 
experiments, with chickens, cats, dogs, and one monkey, was that 
ammals do ?wty in general, imitate and that they do not learn by imita- 
tion Instead, Thorndike believed that learmng was always, or at least 
most commonly, due to ‘‘trial and error ” 

While among the most astute of modern behavior theorists, Thorn- 
dike was handicapped in two ways In 1898, and for a good many years 
to come, psychologists placed more explanatory reliance upon the 
concept of “instinct” than is today thought justifiable, with the result 
that they sometimes interpreted as “due to instinct” behavior which 
would now be analyzed in terms of the more subtle learning processes 
Thorndike’s recognition of the obvious fact of imitation in the par- 
rot but his dismissal of it as a peculiarity (instinct^ ) of the species is an 
illustration of this common tendency 

At the same time, Thorndike knew httle or nothing about the phe- 
nomenon of secondary reinforcement If he had, he might have been 
more disposed to interpret the imitativeness of parrots in terms of 
learning (rather than instinct), and he might also have been less in- 
chned to deny the occurrence of imitation in other species So strong, 
m fact, were his preconceptions on this score that he was inclined to 
discount the contrary testimony of piofessional animal trainers — 
though, with true scientific integrity, he reported it Said he 

It seems arrogant and may seem to some unjustifiable thus to discard 
testimony, to stick to a theory based on one’s own experiments in the face 
of these opinions If I had wished to gam applause and avoid adverse 
criticism, I would have abstained from upholding the radical view of the 
precedmg pages At times it seems incredible to me that the results of my 
experiments should embody the truth of the matter, that there should 
be no imitation The theory based on them seems, even to me, too radical, 
too novel It seems highly improbable that I should be right and all the 
others wrong But I cannot avoid the responsibility of giving what seems 
to my judgment the most probable explanation of the results of the ex- 
periments, and that is the radical explanation already given (pp 63-64) 

Perhaps Thorndike erred in giving too much generality to his ob- 
servations with cats, which he used especially often in his researches 
He was very possibly coriect in holing that these ammals cannot 
easily be taught by putting-through procedures, but cats are curiously 
remote and independent creatures and seem to resent direction and in- 
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terference The dog, on the other hand, which in terms of docility is 
much closer both to the laboratory rat and to man, benefits and benefits 
greatly by being put through responses which are problem-solving 
but otherwise unlikely to occur We have already discussed the fa- 
miliar procedure of teaching a dog to “shake hands,” and many other 
instances could be added For example, the common practice in teach- 
ing a dog to “roll over” involves passively rolling the dog over and 
then rewarding it with food Professional animal trainers are often a 
little jealous of their special knowledge and skill, so that we do not 
know precisely how it is that they get their subjects to do many of the 
remarkable tricks one commonly sees, but it is a safe surmise that 
“putting through” plays a sigmficant role in at least the early part of 
such training Moreover, it is entirely possible that after much training 
and experience a dog, chimpanzee, or other intelligent type of ammal 
might begin to show genuinely imitative behavior, even though naive 
animals of the same species do not Harlow (1949) has brilliantly dem- 
onstrated the development of what he calls learning sets or “learmng 
to learn” in monkeys, with central emphasis upon discriminative learn- 
ing (Mowrer, i960, see Chapter 12) It would seem equally possible 
that when the solution to a problem lies, not in discrimination, but in 
so-called imitation, there might hkewise be a progressive improvement 
as the subject moves from one such task to another, and another, and 
another (cf Section X and Chapter 5, Section IX) 

What are we to make, then, at this vantage point in time of Thorn- 
dike’s treatment of the problem of imitation^ Surely it is difficult to 
avoid the surmise that his perception of the facts was heavily colored 
by a theoretical bias If Thorndike’s version of Connectiomsm was 
vahd, it followed that living orgamsms learn only by doing that is, 
the only way an orgamsm can learn is to do sometlung (“exercise a 
connection”) and then experience reward or pumshment In this, and 
only this, way could bonds, or connections, presumably be modified 
Imitation, if real qua phenomenons constituted a major embarrassment 
for Thorndike, and it was apparently easier for him to question the 
facts than to formulate a new and more adequate theory of learning 
in general The bond notion of learmng was a great stumbling block 
and had to be discarded before real progress could be made along 
these lines In the last section of this chapter, we shall see just how 
liberating and potent revised two-factor theory is by comparison 
But It will first be necessary to follow certain other lines of develop- 
ment In the section immediately following we shall review efforts 
which have been made, again without much success, to derive an ex- 
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planation of imitation in terms of classical Pavlovian conditioning prin- 
ciples Next, in Section IX, we shall examine the approach which 
Miller & Dollard make to this problem in their book. Social Learning 
and Imitation (1941) Because Hull’s theory of learning was basically 
Thorndikian, and since the position taken by Miller & Dollard draws 
heavily upon Hull (but is also at least obliquely influenced by classical 
conditiomng theory), we are not surprised to find some of the same 
limitations in their treatment of this problem that characterize Thorn- 
dike’s analysis In Section X will be described the remarkable observa- 
tions of Hayes & Hayes on imitation in a domestic chimpanzee, which 
no prior theory seems able to encompass But for revised two-factor 
theory they are made-to-order 


Vill. Imitation and the Conditioned Reflex (Humphrey, Holt, and 
Piaget) 

To the best of the present writer’s knowledge, the first systematic 
attempt to explain imitation in terms of conditioning principles was 
made in 1921 by Humphrey After noting the ubiquity of imitative 
behavior in both man and ammals (in contrast to Thorndike’s posi- 
tion), Humphrey came to grips with his sub)ect as follows 

There is here presented an analysis of the seemingly simple process of 
imitation and an attempt to show that it consists of highly complex mtegra- 
tions of a peculiar type of conditioned reflex The fundamental thing 
about an imitative response is that it is similar to the stimulus which pro- 
duces It In each case the response I make is m some way similar to the 
stimulus (pp 2-3 ) 

This writer then refers to the familiar notion of reflex chains or se- 
quences which have a beginning and an end, and he also speaks of circu- 
lar sequences of action such as that involved in many lepetitive per- 
formances, such as hand-feeding a printing press 

But suppose that our unit is very small so that the response acts as a direct 
stimulus for an identical response There is the case of the crying baby 
Originally the stimulus was perhaps a pain, but as the child cries he hears 
himself crying Then we have S producing R, and with it the auditory 
stimulus S2, the sound of the baby’s own crymg in the baby’s ears Hence 
by the law of substitution of stimuli, S2, the auditory stimulus, produces 
R, the reaction, and the more the baby cries the more he cries A 
similar phenomenon may be observed with animals One restive dog will 
keep the whole dog population of the district barking A crowing cock will 
start all other cocks crowing Action of this type may be regarded as the 
elementary unit of imitation It depends upon the fact that man and animals 
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have senses by which they can perceive the reactions to stimuli jrom the 
same or other senses It is a particular kind of conditioned reflex, where the 
response acts as a secondary stimulus It comes from a psychological in- 
breeding, a kmd of parthenogenesis of behavior (pp 3-4, italics added) 

Here was an adumbration of the notion of the reflex circle which 
E B Holt was soon to popularize, but the palpable difficulty with it 
was that it accounted for too much That is to say, as Miller & Dollard 
(1941) have observed, there was no way of explaimng how a reflex 
circle, once activated, ever stops The passage just quoted is neverthe- 
less a sigmficant one, particularly because of the words in italics Here 
we see a clear recogmtion of the phenomenon of response-correlated 
stimulation, or sensory feedback from behavior, which is so essential, 
not only to an adequate understanding of imitation, but of habit forma- 
tion in general But without a better grasp of reinforcement (and of 
what It IS, precisely, that gets conditioned) than was available in 1921, 
this analysis was severely handicapped 

The point has also been made against the conditioned-reflex inter- 
pretation of imitation, and particularly as it applies to language learn- 
ing, that there is no unconditioned stimulus for words and thus no way 
of getting the infant to imitate others This objection cannot be met 
in an entirely satisfactory manner, but Humphrey gave a partial answer 
in the following observations 

Breed (1911) reports that pigeons placed in a cage where they could 
see other pigeons eatmg, pecked the ground although no food was given 
them [cf Section VI] The sight of other birds pecking had become a 
conditioned stimulus for peckmg Here the imitation is direct from other 
animals, and does not depend on the animal’s own activity 

If the mother happens to gurgle at the same time as the child is gurgling 
and makmg few other movements, and gurgles more frequently when the 
child gurgles, then after a time the gurgle from the mother will call forth 
the “imitative” gurgle from the child Here the original secondary stimulus 
comes from without, and we have a kind of converse of type one There 
may be other types, but all will be found to depend, as these do, upon the 
estabhshment of a conditioned reflex where the secondary stimulus is similar 
to the reaction Imitative action may be deflned as action involving a condi- 
tioned reflex the secondary stimulus of which is similar to the reaction (pp 

4-5) 

In 1924 F H Allport (pp 183-189) attempted to handle the prob- 
lem of language learmng along much the same lines, and in 1931, in his 
Animal Drive and the Learning Process, E B Holt wrote as follows 

There is an amusing and instructive little game that can be played with a 
child, say of five years, that illustrates three points that I would brmg out 
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At a moment when the child is in good humour and not keenly bent on 
any special activity, one stands up m front of the child smiling, and copies 
whatever movement the child happens first to make The child will almost 
infallibly (smile and) repeat his movement One repeats after him He will 
repeat again, and with each repetition the child’s movement becomes more 
energetic and longer in sweep Now when the game is in full swing, 
if the older person introduces a new movement the child will almost in~ 
fallibly imitate it, and this will start a new sequence 

The little game brings up more points than the three that I wish to em- 
phasize here Of these three, the first is that the increasing vehemence of the 
child’s repetition of his own and the other person’s movement is directly due 
to echo 

Secondly, when the game is in full swing, and the older person introduces 
some new motion, the child will copy it 

Thirdly, our game with the child sheds some little light on the process 
known as “leadership ” When the game is m full swing it becomes at times 
ambiguous as to which individual is leading, and which is copying, the other 

(pp 117-119) 

The experiments of Miller & Dollard which are to be discussed 
presently seem obviously to have been inspired by these observations 
by Holt But at least the theory behind these experiments came more 
directly from the Thorndike-Hull tradition, so we shall deal with them 
independently rather than in the present context More in line with 
the immediately preceding discussion are the views of Piaget on the 
subject of imitation as set forth in his 1951 book, Flay^ Dreams, and 
lmitati 07 i in Childhood But first one word more, of a somewhat paren- 
thetical nature, concerning the “game” described by Holt It is easy 
to verify that children are intrigued by, and easily involved in, such 
a procedure But the interpretation Holt gives of it seems much too 
simple Note, first of all, that the child used in the example is five years 
old, and therefore a quite highly socialized little creature Having an 
adult do what it does must be quite a novelty, indeed, and we can 
hardly be surprised if some interest and excitement ensue It seems 
most unlikely, however, that anyone could ever get a bird to “talk” 
by this device, and it seems equally improbable that anyone could, 
for that matter, succeed in teaching language to a human infant m this 
way But we nevertheless discover that such an expert on child develop- 
ment as Jean Piaget, in the work already cited, subscribes to a virtually 
identical doctrine He says 

In order to stimulate the baby’s voice, the other voices must either repro- 
duce certam familiar sounds already uttered by the child, or certain intona- 
tions known to him Moreover, the child must be interested m the sounds he 
hears, in which case the contagion is in no way automatic, but is a kind of 
spontaneous circular reaction In a word, vocal contagion is mere stimulation 
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of the child’s voice by another voice, without exact imitation of the child’s 
voice 

Secondarily, there is mutual imitation, which is apparently exact imita- 
tion, when the experimenter imitates the child at the very moment when he 
is uttering this or that particular sound The child then redoubles his efforts 
and, stimulated by the other voice, imitates in his turn the sound his partner 
is imitating The child makes no effort to adapt himself to the sound 
he hears, but merely has to retain the sound he himself was making a mo- 
ment earlier, and his imitation is only a continuation of the circular reaction 

(pp lO-Il) 

When the child now hears others making sounds similar to those he 
himself makes, accommodation to these sounds is inseparable from a schema 
of assimilation already formed, and thus at once sets the schema in motion, 
the result being imitation (p 14) 

Despite the fancy vocabulary, it is clear that Piaget is saying (and 
saying rather less well) substantially what Holt, Humphrey, and others 
have said much earlier Since Thorndikian theory was so completely 
inadequate to account for imitation, it is not surprising that various 
writers should have tried to explain this phenomenon along Pavlovian 
lines But since the very heart of Pavlovian theory has had to be modi- 
fied to make it viable as far as a general psychology of learmng is con- 
cerned, one would hardly expect a theory of imitation derived from 
the classical form of this theory to be anything very different from 
what It mamfestly is Namely, a feeble fabrication which is neither 
logically consistent noi empirically well supported 

Therefore, we leave this line of inquiry and speculation with a some- 
what paradoxical evaluation Although conditioning is the core of the 
learmng process, traditional conditioning theory has taken its advocates 
on a proverbial wild-goose chase as far as the understanding of imita- 
tion is concerned The line of developments to be considered in the 
next two sections points in a far more promising direction 

IX. Miller & Dollard on Imitation and Language 

Thorndike, as we have seen in Section VII, in effect repudiated the 
whole problem of imitation, and the attempts to derive a satisfactory 
explanation thereof in terms of classical conditioned-reflex principles 
were likewise unavailing Therefore, the effort made by Miller & Dol- 
lard, in 1941, to approach this problem in terms of Hull’s attempted 
synthesis of Thorndike’s and Pavlov’s views (Mowrer, i960. Chapter 
3) attracted much interest and attention The following excerpts, taken 
from the Miller-Dollard book, carry us quickly to the heart of their 
analysis 
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Two children were playing in their bedroom, which was adjacent 
to the family kitchen The kitchen opened upon a back stairway It was 
SIX o’clock in the evening, the hour when father usually returned home, 
bearing candy for the two children While playing in the bedroom, Jim 
heard a footfall on the stairs, it was the familiar sound of father’s return 
The younger child, however, had not identified this critical cue Jim ran 
to the kitchen to be on hand when father came to the back door Bobby 
happened on this occasion to be running in the direction of the kitchen and 
behind Jim On many other occasions, probably many hundreds, he had 
not happened to run when Jim did He had, for instance, remained sitting, 
continued playing with his toys, run to the window instead of the door, 
and the like, but on this occasion, he was running behind his brother Upon 
reaching the kitchen, Jim got his candy and Bobby his 

On subsequent nights with similar conditions, the younger child ran more 
frequently at the mere sight of his older brother running When he ran, 
he received candy Eventually, the behavior, under pressure of continued 
reward, became highly stabilized, and the younger child would run when 
the older ran, not only in this situation but in many others where time and 
place stimuli were different He had learned m this one respect to imitate 
his older brother, but he had not learned to run at the sound of his father’s 
footfall (94-95) 

Miller & Dollard, using their familiar drive-cue-response-reward 
paradigm, then make the following theoretical analysis of the fore- 
going example of imitation They say 

The relationship between the acts of leader and imitator can be put to- 
gether into one diagram as follows 



Leader 


Imitator 

Drive 

Appetite for candy 


Appetite for candy 

Cue 

Father’s footfall 


Leg twinkle of leader 

Response 

Running — = rrir:r". 

-dependent- ' 

matched 

Running 

Reward 

Eating candy 


Eating candy 


It will be noted above that the responses are matched^ thus fulfilling one im- 
portant condition of imitative behavior It is further clear that the response 
of the imitator is elicited by cues from the act of the leader His behavior 
is therefore dependent on that of the leader Simple, or simple-minded, as 
an analysis so detailed of an incident so humble may seem, it represents, 
nevertheless, a large class of cases of social behavior which is called imita- 
tive Such cases are frequently encountered when the history of the act is 
not known, and therefore the observer cannot be certain that the imitative 
act was learned Every case ought at least to be examined to see whether 
the variables called for by the learning hypothesis are not in fact present 
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The chapter immediately following the one from which the fore- 
going excerpts are taken begins thus 

An analysis of an observed example of imitative behavior has led to the 
conclusion that certain conditions of social life reward the learning of 
imitation An attempt will be made to verify experimentally the deduction 
that imitation will actually be learned whenever these conditions are present 

(p 98) 

The experiments carried out in this connection are summarized by 
Miller & Dollard as follows 

In this series of experiments, albmo rats that had been living together in 
a conventional type of wire cage were first tested to see if they had any 
initial tendency to perform a very simple type of imitative response The 
response selected was that of tummg in the same direction as a leader at 
the juncuon of a T-maze It was found that animals raised under these con- 
ditions had no marked mitial tendency either to imitate by going m the 
same direction as the leader or to non-imitate by going m the opposite 
direction Then the animals were divided into two groups One group was 
rewarded for gomg m the same direction as a leader, the other group was 
rewarded for gomg m the opposite direction Under these conditions, it 
was found that the two groups gradually learned to imitate and to non- 
imitate, respectively 

In order to make the situation more parallel to many of the social situa- 
tions m which mutation would be expected to be learned, the responses 
of the leaders were guided by black and white cards which they had learned 
to use as cues Control tests, m which the cards were removed and leaders 
were used that had been trained to make either right or left turns, indicated 
that under the conditions of the experiment the animals learned to use the 
response of the leader as their cue 

After this simple type of imitation had been learned in one situation, 
tests indicated that it generalized, that is, appeared without additional train- 
mg m other similar situations The two groups trained to imitate and non- 
imitate white leaders showed a highly reliable tendency, respectively, to 
imitate and non-imitate black leaders After the two groups had learned to 
imitate and non-imitate when motivated by hunger, they showed a highly 
reliable tendency to imitate and non-imitate when motivated by thirst After 
learning to imitate and non-imitate on the long, narrow runway of the 
T-maze, they showed a tendency, which, however, was not statistically re- 
liable, to imitate and non-imitate m steppmg off a small, square startmg 
platform onto one of four adjacent square platforms 

That animals can learn the response of imitating (or non-imitating) under 
appropriate conditions of drive, cue, and reward, and that this response 
learned m one situation generalizes to other similar situations, confirms the 
theoretical analysis made m the preceding chapter (pp 1 19-120) 

The Miller-Dollard analysis of imitation has sometimes been criticized 
along these hnes It has been pointed out that their experimental am- 
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mals “imitated” (see also the example of the two children) only in the 
sense that one subject gets its cue for a particular action from like (oi 
unlike) action on the part of another subject Hence, it might be said 
that Miller & Dollard were not really studying imitation at all, but 
simply discrimination in which the cue stimulus is provided by the 
behavior of other organisms Their rejoinder would probably be that 
imitation ts “simply disci imination” of the kind just described, and 
they might then point out that what they have done, in effect, is to 
show that so-called imitative behavior is just a special instance of quite 
general principles 

The over-all theoiy of learning on which the Miller-Dollard analysis 
of imitation is based may be summarized as follows It holds that theie 
are four aspects or elements involved in learning drive^ cue^ res'ponse^ 
and reix)ard Said otherwise, for learning to occur, the subject must 
njoant something (drive), notice something (cue), do something (re- 
sponse), and get something (rewaid) Thorndikian theory specified only 
three of these four elements drive, response, and reward The Miller- 
Dollard formulation is therefore closer to that of Hull (Mowrer, 
i960, pp 66-74), where we see the same four elements represented 
And because of the mtioduction of this fourth element, it becomes 
possible to derive at least a limited theory of imitation, which is not 
possible with the simpler, less fully elaborated theory of Thorndike 
However, there is a question as to whether the Miller-Dollard analysis 
of imitation is adequate Can it, for example, account for word learn- 
ing, as this phenomenon occurs in buds and human infants^ Here it is 
hardly a question of the subject’s learning to listen to what the “leader” 
(mother, trainer) says as the basis for determimng what he says as a 
means of solving some practical problem (like getting food) As we 
have seen, all that is necessary for word learning in birds is to have the 
word said, by the trainer, and then followed by food (or some other 
reward) The bird does not have to say the word and then be rewarded 
by food, the secondary (autistic) reinforcement provided by the 
sound of the word is alone sufEcient to bring it into existence 

The position of Miller & Dollard with respect to language learning 
IS suggested in the following paragraph 

A mother was worried because her child seemed to be retarded m learn- 
ing to talk Brief questioning revealed that she was adept at understanding 
the child’s every want as expressed by its gestures Having other successful 

^Schein (1954), using adult human subjects, has confirmed the general Miller- 
Dollard thesis, re imitation, “but Ss’ reactions were highly complex” (p 395), cf 
also pp no-112 
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means of responding, the child was not in a dilemma He only learned his 
old habits of using gestures more thoroughly and consequently did not per- 
form that type of random vocal behavior which would lead to speech By 
gradually pretending to become more stupid at understanding gestures, 
the mother put the child in a dilemma and probably facilitated the learning 
of speech At least, under these modified conditions, this child rapidly 
learned to talk (p 34, italics added) 

At the time Social Leariimg and Imitation was written, the authors 
were well aware of the phenomenon of secondary reinforcement and 
made extensive use of the concept Although they may not have seen 
its full implication for word learning, it is interesting that they did 
anticipate it to some extent, as the following paragraphs indicate 

At the same time that the child is practicing his own crying responses, 
he IS learnmg to respond to the voices of others Adults who are feeding, 
fondling, and otherwise caring for infants usually talk to them, thus cer- 
tam tones of the human voice acquire a reward value and may later be 
used to soothe the fretful child It seems possible that this acquired reward 
value of the sounds in the language generalizes to sounds which the child 
makes while he is babbling and helps to reinforce his babbling behavior 

It would be interesting to compare the babbling behavior of different 
children after an attempt had been made to give different phonemes a special 
acquired reward value One child would be talked to with a certain phoneme 
while being fed and with a different but equally pronounceable phoneme 
while being dressed or having some other routine performed which seems to 
annoy him A second child would be talked to with the first phoneme 
while being dressed and the second while being fed Each child would 
be talked to with both phonemes for an equal length of time The babbling 
behavior of the two children would then be compared The prediction 
would be that the child would learn to babble with the phoneme which 
had been given an acquired reward value more than with the other (p 81) 

Here one sees a clear adumbration of the autism theory of word 
learning, but it was made ancillary to tnal-and-error (the second paia- 
graph )ust quoted is really a footnote), instead of being put forward as 
the first and most basic mechamsm involved in the acquisition of word 
responses Subsequent developments, as regards both theory and re- 
search findings, seem to give greater support to the autism theory of 
language learning than to “babble-luck” theory, of which the mam 
Miller-Dollard theory is a variant 


X. Imitation and "Speech" in the Chimpanzee 

In September, 1947, Dr and Mrs Keith Hayes “adopted” a three- 
day-old chimpanzee baby from the Yerkes Laboratories of Primate 
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Biology, at Orange Park, Florida, where Dr Hayes was employed as 
a research psychologist Dr and Mrs Hayes took “Viki” into their 
home and treated her, as nearly as possible, as they would have a baby 
of then o\\ n She was clothed, fed, played with, toilet trained, and dis- 
ciplined in the conventional human ways, and the lesult was that she 
developed some remarkably human chaiacteiistics In 1951 Mis Hayes 
published a delightful account (with pictuies) of this venture, in a 
book called Ape m Our House Here, in a chapter entitled “Monkey 
See, Monkey Do,” Mrs Hayes graphically indicates what an inveterate 
little imitatoi Vila had become by the time she was about three yeais 

old 21 

Viki showed her first evidence of imitation at sixteen months of age, 
when she began crudely copying my household routine — dusting, washing 
dishes, pushing the vacuum cleaner about In a very short time, however, 
we began to wish that Viki were not quite so enterprising For instance, 
one day she claimed the grater from my lemon-pie-makmg residue, helped 
herself to a lemon from the refrigerator, and grated it all over the living- 
room rug (p 18 I ) 

As Viki matured, both physically and in terms of her experience 
in the Hayes household, hei “aping” became even more remarkable 

Sometimes she saw us using materials to which she would not have 
access until hours later Nevertheless, by “delayed imitation,” she must 
try her skill One night she watched me dab furiously with a washcloth, 
trying to remove spilled milk from my skirt The garment was left hanging 
in the bathroom, and Viki was shortly put to bed, but the next morning 
she took down the skirt, wet the washcloth, and rubbed at the spots (p 182 ) 

Mrs Hayes then goes on to say 

It was not necessary to teach Viki to imitate, she had already done so 
in play What we had to teach her was the meaning of the command “Do 
this’” so that she would imitate our actions even when they seemed point- 
less (p 182) 

Mrs Hayes says that Vila’s imitativeness developed as a pait of hei 
play, le, as activity engaged m because it was self-rewarding lather 
than objectively instiumental The same assumptions underlie what 
we have called the “autism” theoiy of word learning But just as Vila 
soon reached the point, with training, where she would imitate on 
command, so do children reach a similar stage with respect to the 
imitation of words When they have reached the point that they repeat 

^For a more technical description of this research, see Hayes & Hayes (1951, 

1952) 
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words on command, then they can be given names and other instru- 
mentally useful words, and their language acquisition can proceed by 
leaps and bounds (or, should we say, by verbs and nouns) Thus, it 
will be deal that our view does not limit word learning to the autism 
principle, we hold that it is merely the mechamsm whereby word 
acquisition gets Mited 

That Vila’s imitativeness was not just some inherent, instinctive 
tendency was proved by the fact that a young chimp, of the same 
age, which w^as borrowed fiom the colony at Yerkes Laboratories for 
the purpose, showed none of the spontaneous imitativeness so char- 
acteristic of Viki and failed completely at special problem-solving tasks 
where the solution could be learned by watching Dr or Mrs Hayes 

The major finding of this senes of problems was that Viki was able to 
do the various kinds of imitation approximately as well as children Since 
we used only one educated chimpanzee, our study is not offered as a quanti- 
tative evaluation of anthropoid imitative ability But it does show that her 
species has the innate factors necessary for imitation This was not true 
of speech, where no amount of training could make up for Viki’s innate 
deficit (pp 188-189). 

As explained by Mrs Hayes in a preceding chapter, Viki, at an early 
age and in spite of hei total separation fiom other chimpanzees, ex- 
hibited ‘‘standard chimpanzee vocalizations,” which are “instinctive, 
appearing m all chimpanzees, and persisting into adulthood with little 
change” (p 61) These were an apprehensive “Oo 00, 00 00,” a scold- 
ing bark “rhow’” and a special food sound, “a staccato stream of ^’s 
(as m wet), the lips drawn back over the teeth” (p 61) But Viki did 
very little babbling of the kind which is so characteristic of human 
infants, and her foster parents had the impression that vocalizations, 
other than the instinctive ones, were not at all easy for her to make 

Suddenly, one day when she was ten months old, she began making a 
very strange new sound The first time we heard it we were surprised and 
vaguely displeased for it was an ugly sound, hoarse and strained It was 
like someone whispering “ah” as loudly as possible and with great effort 
When Viki said it her face contorted while her eyes assumed the tense 
preoccupied stare of a stutterer Then from her lips burst this raspmg tor- 
tured “ahhhh ” She then confidently reached for the milk, so that we con- 
cluded she had at last gotten the idea of speaking for food From then on, 
whenever we told her to speak, she replied with this straining “ahhh,” 
and we came to call it her “askmg sound ” 

Why was it so terribly hard for Viki to make this sounds As we pon- 
dered this question, and re-examined our notes on Viki’s “speaking” for 
food, we realized an astonishing fact Before our coaching Vikt had been 
completely unable to make any sound at all on purpose She made chimp 
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noises, yes, but these were beyond her cojitrol They were merely reflex 
expressions of her feelings If she could have uttered even these voluntarily, 
she would have spoken up more quickly to get her food As it was, she had 
to be disturbed before these burst out, and except for the chimp noises, 
Viki had been noiseless’ 

Why was Viki unable to vocalize when she wanted to, when her supper 
demanded it^ Perhaps because the ape, for all its humanlike vocal apparatus, 
lacks the neural organization necessary for voluntary speech, perhaps be- 
cause she did not babble, perhaps some interdependent combination of the 
two was responsible for Viki’s shortcoming In any case until now she could 
not vocalize on purpose She had lacked the motor sMl of vocalization 
(pp 65-66) 

These observations are consistent with the conjecture, expressed 
earlier, that birds alone are able to reproduce human word sounds with 
some success because they are umque (among infra-human organisms) 
in possessing the special brain-to-muscle “wiring” needed for flexible 
control of the vocal apparatus And it can hardly be doubted that the 
greatest single “mutation” which separates man from other anthropoids 
consists precisely of this new and more abundant neural connections 
between the speech centei in the brain and the speech organs’ (See also 
Chapter 4, Section II ) 

That language failure in the chimpanzee cannot be attiibuted to any 
lack of “intelligence,” in the sense of general leaimng ability, is clear 
The paragraphs quoted show what an energetic and clever imitator 
Viki was with respect to her foster parents’ nonvocal behavior And 
presumably the same learning principles were involved that we have 
postulated as being responsible, in human infants and birds, for suc- 
cessful woid learning Vila learned to love her foster parents, par- 
ticularly her “mother the latter’s activities, because they mediated 
important primary satisfactions for Viki, took on powerful secondary- 
reinforcement properties, and there was a generalization thereof from 
the sight of “mother” performing them to the sight (sounds, and feel) 
of Viki pel forming them But, as Dr and Mrs Hayes shrewdly sur- 
mised, Viki simply was not capable of doing the things “mother” did 
in the area of vocalization, and so never learned to “talk ” With 
great patience and effoit on the part of all concerned, Viki did learn 
to whisper “mama” and “cup ” But this is wheie the matter ended 

Certainly the Hayes’ observations with Vila show the erior of 
Thorndike’s contention that imitation does not occur m mammals other 
than man Where it was really absent was in his theory, and because of 
this deficit, he never was inspired, either in the laboratory or out, to 
create the conditions necessary for the occurrence of this phenomenon 
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Also we see that the Miller-Dollard analysis of imitation, in terms of 
doing something on cue, is unsatisfactory Vila not only showed de- 
layed imitation’ —It is also clear that the activities imitated, instead of 
being instrumental means to other (primary) satisfactions, provided 
their own (secondary) reward On the other hand, all the observa- 
tions reported by Hayes & Hayes seem to be consistent with and sup- 
portive of the “autistic” theory of word learning and imitation gen- 
erally and of the over-all conception of habit formation (both direct 
and mediated) with which this book is concerned 

XI Concluding Comment 

The autistic conception of word learning, as elucidated in this chap- 
ter, provides a particularly good illustration of revised two-factor 
theory in action However, it would be a mistake to suppose that it was 
deduced from this theory The truth is that the autistic interpretation 
of word learning came first (Mowrer, 1950, Chapter 24) and was not 
followed by a statement of the general theory which it exemplifies 
until considerably later (Mowrer, 1956) The advantages of research on 
talking birds (alluded to in Section I) were even greater than orig- 
inally supposed’ 

Now we not only have a new and improved theory of habit forma- 
tion, we also see moie clearly than before the relation of this phe- 
nomenon to so-called imitation In imitation the imtial “model” for an 
act IS supplied by orgamsm A, but the reward (reinforcement) goes 
to orgamsm B In other words, to revert to the work with the talking 
birds, the trainer makes a particular noise and the bird gets fed, 
watered, or in some other way rewarded The result is inevitable the 
stimulus consequences of A’s action, as they impinge on B, take on 
secondary reinforcement, and B, when properly motivated, tries to re- 
create them — ^in short, “imitates” This, when one thinks of it, is a 
remarkable phenomenon what is at first a stimulus produces a re- 
sponse which reproduces that stimulus 

But imitation, so conceived, is really no more remarkable than is 
“ordinary” habit formation The principal difference, it seems, is sim- 
ply this, that in habit the learner himself provides the original “model ” 

^At this level of “imitation” one is probably justified m also using the psy- 
choanalytic term, idenuficatton The emotional conditions m Viki and in her re- 
lation with the foster parents were apparently right for her to become, fully and 
completely, their “child” There was only one, crucial difficulty Vila could not 
learn to talk 
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That IS to say, an organism acts in a particular way (with certain 
stimulus consequences), its action (we assume) is followed by re- 
ward, and the result is that these stimulus consequences (or response- 
correlated stimuli) take on secondary-reinforcing (hope-aiousing) 
capacity, and, when again properly motivated, the orgamsm “imi- 
tates” — except that we now usually say “repeats” — ^what it (rather than 
some other orgamsm) did before 

In imitation and in habit alike, then, we can say a model for or image 
of desirable, am active, cathected, promising action emerges (see Chap- 
ter 5 of this book, also the discussion of skill in Mowier, i960. Chap- 
ter 12) The sensory consequences of such action have taken on sec- 
ondary reinforcement as a result of having been first produced by 
another oigamsm (in imitation) or as a result of having been first pro- 
duced by the organism itself (as in regular habit) In both instances 
the response-correlated stimulation has “worked” in the sense of “pro- 
ducing” (being followed by) reward for organism B And when B 
wants more of this reward or wants it again, we would expect B to 
attempt to reproduce this stimulus constellation (by means of the 
appropriate action) , in much the same way regardless of whether the 
stimulus pattern or model was originally produced by organism A or 
by orgamsm B 

But now an important distinction must be made When an or- 
gamsm recreates a constellation of stimuh winch, as a result of past 
action by the orgamsm itself, has acquired secondary-reinforcement 
potential by virtue of that action having produced reward of some 
sort — ^when this occurs, the organism will, of necessity, also have 
reproduced the previously effective action^ which will now again be 
hkely to produce the desired satisfaction But what of imitation^ By 
reproducing the pattern of stimulation originally provided by or- 
gamsm A, organism B may be able to re-experience (autistically) 
some of the satisfaction previously associated with this stimulation 
But will the reproduction thereof have the same likelihood of being 
instrumentally effective, 1 e , of producing again the desired satisfac- 
tion, as does a regular “habit”^ The answer seems to be that, in gen- 
eral, imitative action is instrumentally effective only if a second or- 
gamsm is present to act as an intermediary, as in the original learning 
situation, except that instead of A producing a given pattern of stimula- 
tion and then rewarding B, B now piovides the stimulation and A 
reacts to it Thus a child, if our analysis in this chapter is correct, first 
reproduces a word because of the indirect, autistic satisfaction which 
the word provides, but then the word may prove efficient in a more 
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practical way in that it causes the patent again to supply the satisfaction 
with which his original pronunciation of the word was associated In 
ordinary habits the situation is a httle different since the reinforce- 
ment is initially not socially mediated, it does not have to be subse- 
quently But tins difference does not detract from the basic similarity 
of the principles involved in the two situations 

Interestingly enough, in his book, MtJid, Self^ and Society ^ G H 
Mead (1934) has a footnote which reads as follows 

An attempt was made by Baldwin (1912) to carry back imitation to a 
fundamental biological process — a tendency on the part of the orgamsm to 
reinstate a pleasurable sensation In the process of mastication the very 
process of chewing reinstates the stimulus, bringing back the flavor Baldwin 
would call this self-imitation This process, if it takes place at all, does not 
by any means meet the situation with which we are dealing (p 64) 

Here, it seems, was a remarkable anticipation of the analysis pre- 
sented in the preceding pages Both imitation and habit (“self -imita- 
tion”) were made to depend on the same principles, and these im- 
portantly involved the notion that any stimulation which is associated 
with pleasure (today we say reward or reinforcement) will take on a 
derived pleasure and will cause the subject to try to “reinstate” this 
stimulation But Baldwin’s shiewd suggestion never “took hold,” as 
evinced by Mead’s casual rejection of it The reason, very probably, 
was that it was made at a time when refiexological and “bond” learmng 
theory was coming into vogue, and as we have seen earlier m this 
chapter, the bond theory of habit (particularly as developed by 
Thorndike) automatically excludes the possibility of imitation But 
now that we have a revised, and seemingly more realistic, conception of 
habit, we find it does indeed articulate with imitation, in very much 
the way Baldwin suggested 

"®Much the same idea is expressed by Humphrey (1921) when he says “The 
general connection between imitation and repetition [habit] is very marked In 
fact It is hard to say where one ends and the other begins, whether repetition 
IS not ‘self-imitation’ just as often as it is response to repeated sumuli Here we 
have repetition of an action imitated from others, this may be either response 
to repeated stimuli or imitauon of self, the primary and secondary stimuli being 
identical In either case the examples show the way in which integration adds 
step-by-step to the system” (p 6) 

It goes without saying that exactly the same reasons can be applied to explain 
the negative imitation — not to be confused with the inverse or nonmatching be- 
havior of Miller & DoUard’s (1941) experiments — which results when the action 
of organism A is followed by punishment to organism B Here the same prin- 
ciples are operative as in “ordinary” pumshment, le, punishment applied to B 
for somethmg B (rather than A) has done 
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It IS, patently, an advantage thus to have a common set of assumptions 
from which imitation and habit formation (in both their positive and 
negative aspects) are equally derivable Moreover, having arrived at this 
point, one can go even further and note yet another possible form of 
“vicarious” learning Suppose that organism A not only provides the 
“model” but also experiences the reinforcement If an observing or- 
ganism, B, experiences some of the same immediate sensory conse- 
quences of A’s behavior as A experiences it and also “intuits” A’s satis- 
factions (or dissatisfactions), then we may suppose that B will be ren- 
dered more or less likely to repeat A’s behavior, although, to what is 
involved in simple imitation, is here added the element of empathy 
The extent to which this “higher-order” vicarious learmng occurs in 
animals is perhaps open to debate, but it occurs very commonly at the 
human level and is verbalized by the remark “If that kind of behavior 
IS good (or bad) for others, it will probably be good (or bad) for me, I 
think I will (will not) try it myself ” 

Thus, our basic principles provide a satisfactory and unified explana- 
tion of habit foY777ation (response, with resulting stimulation, provided 
by individual B and reinforcement experienced by individual B), imita- 
tion (response, with resulting stimulation, produced by individual A 
and reinforcement experienced by individual B), and empathetic learn- 
ing (response, with resulting stimulation, produced by individual A 
and reinforcement experienced by individual A but with B also ex- 
periencing the reinforcement, vicariously) Putting through (Adowrer, 
i960. Chapter 7) is logically between habit formation and imitation, 
in that individual B experiences the reinforcement and also “performs” 
the response but passively, under the initiative and guidance of in- 
dividual A Obviously putting through, empathetic learning, and imita- 
tion all involve lateiit lear? 2 mg of sorts, in that the secondary reinforce- 
ment (positive or negative) acquired by the stimuli produced by a 

Since the above was written, two animal studies ha\e appeared which repre- 
sent at least the beginnings of systematic research in this area Church (1959) 
has shown that rats experience fear (as indexed by behavior inhibition) in the 
presence of other fearful rats, and Miller, Murphy, & Mirsky (1959), having 
taught monkeys to operate a lever when afraid, have demonstrated that such 
behavior can be activated by the mere sight of another monkey in a state of 
fear In fact, these investigators even report that “The enhancement of avoidance 
behavior by presentation of pictures of monkeys reacting fearfully indicates that 
exposure of a fearful stimulus animal elicits, through some empathic process, fear 
in the viewer” (p 158) Although these studies do not involve imitative behavior, 
they clearly reflect an imitation of affect which is the essence of empathy (cf 
Luchins, i960, also Chapter 10, Section V) 
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given response as performed by another generalizes to the stimulation 
produced by that response as performed by the individual himself, and 
in this sense a kind of '^mediation” is involved, but there are many 
instances of mediated learning which are not, of course, in any sense 
imitative (Chapter 2 ) In the chapter which follows, mediation will 
be examined in yet another context and form 
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Language and Learning: 
The Psychology 
of Signs and Sentences 


At the outset of the preceding chapter, language was referred to as 
a mediator of learning, as well as a product thereof The processes 
whereby language is learned, as regards both word comprehension and 
word production, have now been reviewed In the present chapter, we 
shall explore the way, or ways, in which language, once mastered as a 
tool, may then function as a means of producing the special kinds of 
learmng that we call co?mnunication 
As a result of preceding discussion, we now have some notion of how 
human infants learn to reproduce and to know the meanings of the 
words they hear about them But this knowledge, alone, gives us a 
very incomplete understanding of the dynamics of language Let us 
therefore ask Why did the race, or why does the individual, njoant 
language^ What good, what practical use is it^ 


L Earlier Theories of Language in Action 

E L Thorndike is one of the few major learning theorists who have 
been seriously interested in language In the preceding chapter we have 
leviewed his thinking about the origin and learmng of language Here 
we shall consider his views concerning its function 
In one respect, virtually all writers are agreed language, they con- 
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cede, has been transcendently important in the evolution of human 
culture and mentality Thorndike ( 1 943 ) evaluates it thus 

Language is man’s greatest invention It is a social tool more important 
than the community, the state, the law, the church, or the school It is an 
intellectual tool as important as observation and experiment, and more im- 
portant than logic It is more important than all the physical tools invented 
in the last two thousand years These assertions mo.} well seem extravagant, 
but they can be justified 

Thorndike then proceeds simultaneously to criticize a common con- 
ception of language and to develop the one which he believes more 
defensible He says 

Let us consider first the function of language It is commonly said that 
the function of language, the service it performs in satisfying human wants, 
is to express thoughts or feelings This statement is inadequate Language 
IS used not only to express but also to arouse thoughts and feelings and still 
more to arouse movements The relation of most importance is not the 
parallelism between the words and the inner life of the one who uses them 
but the effect upon the one who hears or sees them The function of language 
IS fundamentally just the same as that of pushing, pulling, paying money 
to, feeding, clothing, knocking down, or helping up an animal It is to 
produce responses on the animal’s part, to get him to think or feel or do 
something We do not talk exclusively for the sake of expressing our mental 
condition any more than we pay men money exclusively to express our 
satisfaction with their services (p 60) 

But after this vigorous and promising start, Thorndike’s discussion of 
language in action becomes diffuse and umnstructive And a moment’s 
reflection upon this writer’s assumptions concerning the basic cir- 
cumstances of learning will suggest why this should be the case Thorn- 
dike, It will be remembered, though often referred to as an “associa- 
tionist” (in the ‘"connectionist” sense), really did not take much stock 
in the principle of conditiomng 

Thorndike argues, persuasively enough, that the central objective 
of language is to produce a modification or redirection of behavior 
in others But he never comes to grips with the question of precisely 
hozu this influence is achieved Granted that habits of speakmg might 
be developed in the way suggested by Thorndike in the passages quoted 
in the preceding chapter, we are still left with the question of precisely 
how speech affects the hearer Here we must face the problem of 
meaning^ and it would now appear that for a systematic and genuinely 
adequate treatment of this phenomenon, the concept of conditioning is 
indispensable It is small wonder, then, that Thorndike’s discussion of 
language strikes us today as one-sided and incomplete 
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Only a little less remarkable than the extent to which psychologists 
have neglected the field of language as a whole is the extent to which 
linguists themselves have also by-passed its more dynamic implications 
During much of his highly influential career, Leonard Bloomfield dis- 
missed efforts at “psychologizing” language as a waste of time But m 
his well-known book, La? 2 g 7 iage, published m 1933, there is a chapter 
entitled “The Use of Language” m which Bloomfield himself takes a 
turn at this activity Here he says 

Suppose that Jack and Jill are 'walking down a lane Jill is hungry She 
sees an apple in a tree She makes a noise with her larynx, tongue, and lips 
Jack vaults the fence, climbs the tree, takes the apple, brings it to Jill, and 
places It in her hand Jill eats the apple 

This succession of events could be studied in many ways, but we, who 
are studying language, will naturally distinguish between the act of speech 
and the other occurrences, which we shall call practical events Viewed in 
this way, the incident consists of three parts, m order of time 

A Practical events preceding the act of speech 

B Speech 

C Practical events following the act of speech 

There then follows an elaboration of what Bloomfield means by A 
and by C, after which we read 

If Jill had been alone, she might have been just as hungry and thirsty 
and might have seen the same apple If she had sufficient strength and skill 
to get over the fence and climb the tree, she could get hold of the apple 
and eat it, if not, she would have to stay hungry The lone Jill is in much 
the same position as the speechless animal If the animal is hungry and sees 
or smells food, it moves toward the food, whether the animal succeeds in 
getting the food, depends upon its strength and skill The state of hunger 
and the sight or smell of the food are the stimulus (which we symbolize 
by S) and the movements toward the food are the reaction (which we 
symbolize as R) The lone Jill and the speechless animal act in only one way, 
namely 

S 

If this works, they get the food, if it does not work — if they are not 
strong or skillful enough to get the food by the reactions R — they must 
stay hungry (pp 23-24) 

We now see the direction in which Bloomfield’s analysis is moving, 
and shortly he speaks of Jill’s words to Jack being a substitute for R 
and represents them as r For Jack they are in turn a substitute for S 
(his own hunger or thirst which might make him seek the apple) and 
are represented as s Hence, what Bloomfield calls a “speechless” re- 
action (S— >R) becomes transformed into a “reaction mediated by 
speech S^r s->R ” 
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Here Jill feels the stimulus S and makes the reaction r, Jack receives 
the stimulus s and makes the response R, which involves not only 
getting the apple (as if for himself) but also givmg it to Jill 

The difference between the two types [of stimulus-response sequence] 
IS evident The speechless reaction occurs always in the same person as does 
the stimulus, the person who gets the stimulus is the only one who can 
make the response The response, accordingly, is limited to whatever actions 
the receiver of the stimulus can make In contrast with this, the reaction 
mediated by speech may occur in a person who did not get the practical 
stimulus, the person who gets a stimulus can prompt another person to make 
a response, and this other person may be able to do things which the speaker 
cannot The arrows in our diagrams represent the sequence of events within 
one person’s body — a sequence of events which we think is due to some 
property of the nervous system Therefore the speechless reaction can take 
place only in the body which received the stimulus In the reaction mediated 
by speech, on the other hand, there is the link, represented by a dotted line, 
which consists of sound-waves in the air the reaction mediated by speech 
can take place in the body of any person who hears the speech, the pos- 
sibilities of reaction are enormously increased, since different hearers may 
be capable of a tremendous variety of acts Tbe gap between the bodies of 
the speaker and the hearer — the discontinuity of the two nervous systems 
— IS bridged by the sound-waves (p 26) 

The implications of this analysis for a theory of social action and 
interaction are far-reaching Here is a basis for explaining division of 
labor, cooperation, and other powerful cohesive forces in human 
groups (see De Laguna, 1927) Bloomfield then continues and con- 
cludes his discussion thus 

The important things, biologically, are the same m both the speechless 
and the speaking occurrence, namely S (the hunger and sight of the food) 
and R (movements which get the food or fail to get it) These are the 
practical phase of the affair The speech-occurrence, s r, is merely 

a means by which S and R may occur in different individuals The normal 
human being is interested only m S and R, though he uses speech, and 
thrives by it, he pays no attention to it Saying the word apple or hearing 
It said, appeases no one’s hunger It, along with the rest of speech, is only 
a way of getting one’s fellowmen to help As students of language, how- 
ever, we are concerned precisely with the speech event (r s), worth- 

less in Itself, but as a means to great ends We distmguish between language, 
the subject of our study, and real or practical events, stimuli and reactions 
When anything apparently unimportant turns out to be closely connected 
with more important things, we say that it has, after all, a “meaning”, 
namely, it “means” these more important thmgs Accordingly, we say that 
speech-utterance, trivial and unimportant in itself, is important because 
it has meaning the meamng consists of the important things with which 
the speech-utterance (B) is connected, namely the practical events (A and 
C) (pp 26-27) 
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Basically, Bloomfield’s treatment of language is )ust an extension and 
explication of Thorndike’s Both by-pass the concept of meaning as 
an internal conditioned reaction, and both are thoroughly behavioristic 
Thorndike argues that the “expressive,” or subjective, value of language 
IS trivial in comparison with its objective, interpersonal utility, and 
Bloomfield agrees by saying that language is “worthless in itself” and 
valuable only as a means to “practical” ends However, as we shall 
later see, it seems that in disregarding certain of the subjective aspects 
of language, these writers cut themselves off from an understanding 
of language in its most truly and umquely “practical” sense 

Philosophers and logicians have, in some ways, been quite attentive 
to the language problem but usually not in ways which bear upon 
the psychology of language However, a book by Susanne K Langer, 
entitled Philosophy in a New Key (1951), offers an interesting departure 
from the more traditional treatments of language The chapter on 
“Language” begins with these now widely quoted words 

Language is, without a doubt, the most momentous and at the same 
time the most mysterious product of the human mind Between the clearest 
animal call of love or warning or anger, and a man’s least, trival word, there 
lies a whole day of Creation — or in modern phrase, a whole chapter of 
evolution In language we have the free, accomplished use of symbolism, 
the record of articulate conceptual thinking, without language there seems 
to be nothing like explicit thought whatever (p 83) 

Animals are one and all without speech They communicate, of 
course, but not by any method that can be likened to speaking They ex- 
press their emotions and indicate their wishes and control one another’s 
behavior by suggestion One ape will take another by the hand and drag 
him into a game or to his bed, he will hold out his hand to beg for food, 
and will sometimes receive it But even the highest apes give no indica- 
tion of speech (p 84) 

Even though Professor Yerkes’s young apes, Chim and Panzee, met 
their food with exclamations like “Kha^” and “Nga’” these are like a cry 
of “Yum-yum^” rather than “Banana, today” They were sounds of en- 
thusiastic assent, of a very specialized emotional reaction, they cannot be 
used between meals to talk over the merits of the feast (p 85) [cf Cassirer, 

1944] 

Langer then reviews certain untenable theories of language origin 
and function, in human beings, and concludes that in the following 
paragraph, quoted from Sapir (1933), there lies the germ of a far more 
promising approach to the problem 

The primary function of language is generally said to be communication 
The autistic speech of children seems to show that the purely com- 
municative aspect of language has been exaggerated It is best to admit that 
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language is primarily a vocal actualization of the tendency to see reality 
symbolically, that it is precisely this quality which renders it a fit instru- 
ment for communication and that it is in the actual give and take of social 
intercourse that it has been complicated and refined into the form in which 
it is known today (pp 88-89) 

Langer takes her lead from Sapir’s reference to the tendency of 
human beings “to see reality symbolically” But then she asks, why 
is It that we have this tendency so abundantly and our closest of km 
among the apes have it not at all^ Here, after a brilliant beginning, she 
falls back upon a “difference of natural proclivities ” 

The ape has no instinctive desire to babble in babyhood He does not 
play with his mouth and his breath as human infants do, there is no crowing 
and cooing, no “goo-goo” and “ba-ba” and “do-de-la” in his otherwise 
unroarious nursery Consequently there are no sounds and syllables that 
please or frighten him by their sheer aesthetic character, as he is pleased, 
frightened or conforted by purely phenomenal sights Oddly enough, it is 
just because all his utterances have signification — all are pragmatic or emo- 
tional — ^that none of them ever acquire significance He does not even imitate 
sounds for fun, as he imitates gestures, and gravely mimics practices that 
have no utility for him (p 94) 

Although the rest of Dr Danger’s chapter is engaging and, at points, 
highly suggestive, it ends without having developed a well-knit theory 
of either language origination or use One has the feeling that the 
author was looking in decidedly the right direction, but because cer- 
tain experimental facts and theoretical concepts from the learning 
laboratory were not at her disposal, she was unable to capitalize upon 
a sound intuition In contrast to Thorndike and Bloomfield, who stress 
the practicality of language, Langer underscores its subjective qualities 

A genuine symbol can most readily originate where some object, sound, 
or act IS provided which has no practical meaning, yet tends to elicit an 
emotional response, and thus hold one’s undivided attention (pp 94-95) 

Or again 

Young children learn to speak, after the fashion of Victor [the “Wild 
Boy” of Aveyron], by constantly using words to bring things into their 
minds, not into their hands They learn it fully whether their parents con- 
sciously teach them by wrong methods or right or not at all (p 98) 

Hence we see a decided difference of opinion between Thorndike 
and Bloomfield, on the one hand, with their emphasis upon the ob- 
jective and utilitarian function of language, and Langer, on the other, 
who stresses its subjective and autistic aspects Is there not, m the 
preceding chapter of this book, the basis for a happy reconciliation^ 
There we have advanced and empirically supported the view that 
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word-making reactions are initially learned on an autistic basis but 
are then stabilized and perpetuated because they prove to be '‘practical,” 
instrumentally effective Or, in stricter terminology, word-making 
“habits” are acquired because the response-correlated stimuli have ac- 
quired secondary reinforcement potency (that is, words “bring things 
into their minds''')^ but these “habits” also turn out to be “practical” 
and are stabilized and perpetuated through the action of primary rein- 
forcement Bloomfield and Thorndike had only the concept of primary 
reinforcement (“practical effects”), whereas Langer had an intuitive 
grasp of the concept of secondary leinforcement but did not under- 
stand Its systematic relationship to primary reinforcement 

Thus, on the basis of revised two-factor learning theory, we arrive 
at a more complete, more integrated conception of language But a 
large and important issue remains In the preceding chapter we have 
worked out the theoretical details, i e , the mechanism, of word learn- 
ing In the present one, we have acknowledged the practical, inter- 
personal function of words, once learned, but we have as yet no clear 
and precise understanding of how this effect is achieved It might seem 
that we should be able to find an answer in either of two recent move- 
ments that have attracted considerable attention namely. General 
Semantics and Information Theory But the latter, we find, is not at all 
concerned with language in the more general sense of the term, and 
General Semantics, despite its name, is concerned with a really quite 
specific and probably not very important point Wilson (1954) has 
recently appiaised Information Theory incisively yet fairly in these 
words 

As the previous discussion has indicated, information theory’s chief con- 
tribution to the study of language is a set of descriptive measures and a 
unit, the bit, which are much more broadly applicable than to language 
processes themselves It serves chiefly, therefore, as a quantitative tool for 
describing language processes It is not a theory of information in the usual 
sense, nor does it provide us with a theoretical model which can provide 
hypotheses about or explain the phenomena of human communication (p 
24)1 

Although much has been written under the rubric of General Seman- 
tics, the key notion has been dramatized by Hugh Walpole (1941) in 
the following story (see also Korzybski, 1933, and Hayakawa, 1942) 
There was, it seems, a farmer who each day called his chickens into 

^Garner (1958, see also Garner & McGill, 1956) has, m fact, recently suggested 
that the term “information theory” be abandoned, because of its misleading im- 
plications, and replaced by the semantically more neutral and statistically more 
precise term, “uncertainty principle” 



1 24 L EARNING THEORY AND THE SYMBOLIC PROCESSES 

the chicken house and fed them Then came a day when he called 
them into the chicken house and fed them, as usual, but as they ate 
he closed the doors, presently caught them, put them into coops, and 
sent them off to market The chickens had made the error of ''over- 
generali%in^\ because the farmer’s call had in the past been followed 
by food and nothing else, the chickens did not discriminate between 
his friendly calls and the calls he made when he wanted to catch and 
market them (how could they^), and so lost their freedom — and prob- 
ably their lives As indicated elsewhere (Mowrer, i960. Chapter 12), 
discrimination, under some circumstances, is indeed highly important, 
but, under other conditions, the capacity to generalize is equally vital 
So it would seem that the General Semanticist’s mam point is not only 
limited but, possibly, quite misleading (see Winthrope, 1946), and it 
leaves us still looking for the touchstone of a truly general theory of 
language operation ^ This, it seems, we shall have to construct for our- 
selves on the basis of facts and principles already discussed or implied 
m preceding chapters 

II On Signs and Signaling The Biological Background 

of Human Speech 

Because revised two-factor theory reduces all learning to sign learn- 
ing, we have already, m this (and the preceding) book, devoted a good 
deal of attention to the psychology of signs And from this approach 
we have seen that inherent m the theory of sign learning, or condition- 
ing, are the notions of ^‘information” and “meaning” A formerly 
neutral stimulus which is temporally contiguous with either drive 
increment or drive decrement takes on the capacity to arouse fear or 
hope and thus provides the reacting organism with memory of the past 
and knowledge of things to come (see also Chapter 5) When a formerly 
neutral or indifferent stimulus is associated with a significant (rein- 
forcing) one, the first stimulus takes on a representational function, 
coming to mean or stand for the second one This moving forward in 
time of a part of the reaction evoked by a biologically important situa- 
tion, so that the organism can make an anticipatory response of either 
an approach or an avoidant nature, is clearly one of Nature’s most 
ingenious inventions and is a crucial aspect of what we call “intelli- 
gence” and “foresight” (cf Chapter 2) 

Hence from our study of learmng in lower ammals we obtain a sound 

“For an excellent, brief history of the General Semantics movement and a 
critical yet impartial evaluation, see Carroll (1953, pp 160-168) , see also Wemreich’s 
(1959) bibliography 
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conceptual underpinning for the study of language in human beings, 
which IS )ust an intricate system of sign functions There are, however, 
some rather serious limitations in the extent to which a study of am- 
mals can guide us to a fully adequate theory of communication at the 
human level Animals, it seems, are often extremely well equipped for 
the detection of remote and subtle stimuli and for learning, through 
conditioning, to attach special meanings to them But they are much 
less well prepared or disposed themselves to make stimuli that may 
have sign, or signaling, value Animals, of course, inadvertently provide 
some stimuli which may then be reacted to by other orgamsms, for 
purposes of either pursuit or flight They may be seen, heard, smelled, 
etc — all of which is usually a disadvantage to the first organism, so 



going to take a chance 

and answer that one T hey t an^t aU he hunters 


Fig 4-1 A drawing by Rea, reproduced with permission from The Neav Yorker 
(Nov 3, 1945) An alternative legend might be, “Hunters or no hunters, I’m going 
XQ ms%ver that one’” 
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that nature (evolution) has tended to put a premium, through color, 
camouflage, foot-padding, etc , upon inconspicuousness Whenever an 
organism engages in displays of any kind, through appearance, vocali- 
zation, or odors, it is usually as a means of signaling to other mem- 
bers of the same species, commonly for sexual purposes, so that the 
survival of a species often depends upon a subtle balance between in- 
conspicuousness and conspicuousness, between silence and signaling 
The essence of this dilemma has been captured (as is so often the case) 
by a Ne^ Yorker cartoon, which is reproduced here as Fig 4-1 
How effectively “muted” the laboratory rat is in certain situations 
is brought out in a study published a few years ago by Mowrer, Palma, 
& Sanger (1948) It has been shown by numerous researches previously 
cited in this book that if some stimulus or situation is conditioned to 
the response of fear, rats can learn to do any of a wide variety of 
things as a means of relieving the fear and, hopefully, avoiding the 
thing feared Also well established is the fact that rats squeal vocifer- 
ously when subjected to even fairly mild pain, such as that produced 
by an electric shock So it occurred to the authors cited to wonder 
if rats could likewise learn to use this reaction “mstrumentally,” as a 
means of terminating a danger signal and averting shock Fig 4-2 
gives the results As the figure shows, when circumstances were such 
that rats could terminate a danger signal and avoid shock by runnings 
this response was readily learned, but when the rats were required to 
vocalize as a means of achieving the same ends, there was no change 
in performance 



Days 


Fig 4-2 Curves contrasting the 
ease with which two types of 
response — a simple running re- 
action and vocalization — can be 
elicited in laboratory rats on 
the basis of so-called avoidance 
conditioning The curve with 
the solid circles shows the high 
proficiency of one group of 
subjects in learning to run in 
response to a warning signal, 
whereas the curve with the 
open circle shows the very low 
proficiency of a group of com- 
parable subjects in learning to 
vocalize in response to the same 
signal 
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Mowrer, Palma, & Sanger go on to suggest that in rats, and perhaps 
m many other animals, there is an instinctive mechanism which ensures 
their vocalizing when “caught,” as a means of warning other membeis 
of their species of the presence of danger, but which prevents them 
from vocalizing out of fear alone The authors say 

The rat which only sees, hears, or smells an enemy will do well, no 
matter how terrified, to remain silent, either as it crouches in hiding or slinks 
to safety If an animal is “caught,” it does not much matter if it squeals 
both to actual pain (shock) and to the mere threat of pain (the danger 
signal) , but if an animal is “free,” it makes a great deal of difference whether 
It squeals to the mere prospect of pain (thus calling, “Here I am,” to the 
hungry pursuer), or squeals only m response to pain itself (thus urging 
other members of its species to bolt from a possibly similar fate) 

Support for the thesis that animals do well in a state of nature to “suffer 
in silence” and not to cry out when frightened, except when “caught,” 
in indicated by Darwin (1873) following passage 

“We have seen that when the sensorium is strongly excited, the 
muscles of the body are generally thrown into violent action, and as a 
consequence, loud sounds are uttered, however silent the animal may gen- 
erally be, and although the sounds may be of no use Hares and rabbits for 
instance, never, I believe, use their vocal organs except in the extremity of 
suffering, as, when a wounded hare is killed by the sportsman, or when a 
young rabbit is caught by a stoat Cattle and horses suffer great pain in 
silence, but when this is excessive, and especially when associated with 
terror, they utter fearful sounds I have often recognized, from a distance 
on the Pampas, the agonized death-bellow of the cattle, when caught by the 
lasso and hamstrung It is said that horses, when attacked by wolves, utter 
loud and peculiar screams of distress” (pp 83-84) 

Thus we see the reasonableness of the assumption that nature 
(evolution) has taken pains to control and, indeed, suppress vocaliza- 
tion in anmials, except in special circumstances As already indicated, 
about the only state aside from that of capture in which vocalization is 
allowed, in many species, is that where reproduction of the species is at 
stake Again, to quote Darwin 

Although the sounds emitted by animals of all kinds serve many pur- 
poses, a strong case can be made out, that the vocal organs were primarily 
used and perfected in relation to the propagation of the species The 
chief and, in some cases, exclusive purpose appears to be either to call or 
charm the opposite sex (p 290) 

In support of the latter argument Darwin (1885) points out that 
“the sounds produced by fishes are said in some cases to be made only 
by the males during the breeding-season” (p 196) Beach (1944) re- 
ports that the alligator “breeds during the early summer, and it is at 
this time that roaring is most frequently heard” (p 481) Others have 
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remarked on this correlation in other species, but reference is seldom 
made to the fact that even in human beings there is no “change of 
voice” in the male until the advent of puberty Presumably it is only 
at this time that vocal differentiation of the sexes becomes functional 

The circumstances, then, under which terrestrial mammals vocalize 
can be quickly enumerated As adults, animals which are preyed upon 
are likely to be silent save (a) when, as we have seen, they are caught, 
(b) when a mother is separated from her young, (c) when seeking a 
mate, and occasionally (d) when fighting Predatory animals seem to 
have slightly greater vocal freedom in that they may vocalize, not only 
under the four circumstances just mentioned, but also (e) when at- 
tacking an intended victim ^ Thus, says Darwin (1873) 

Rage leads to the violent exertion of all the muscles, including those of 
the voice, and some animals, when enraged, endeavour to strike terror into 
their enemies by its power and harshness, as the lion does by roaring, and 
the dog by growling I infer that their object is to strike terror, because the 
lion at the same time erects the hair of the mane, and the dog the hair 
along Its back, and thus they make themselves appear as large and terrible 
as possible Rival males try to excel and challenge each other by their voices, 
and this leads to deadly contests (p 85 ) 

Thus, from varied lines of evidence we see that vocalization, m a 
state of nature, ordinarily occurs only under fairly specific and critical 
(“emotional”) circumstances How, then, did man, or protoman, ever 
achieve the vocal freedom and versatility required for voluntary 
speech^ Numerous writers have remarked that, under conditions of 
domestication, various species of fowl, dogs, and other animals have 
become somewhat more vocal This has occurred, presumably, (a) be- 
cause domestication provides considerable, if not complete, protection 
against natural enemies and hazards and (b) because man, the domesti- 
cator, probably likes a certain amount of vocalization in his pets and 
other “live stock” as a means of knowing where they are, if they are 
safe, etc But there was no one to “domesticate” and thus protect 7mny 
so e are still faced with the question of how he won through to vocal 
freedom Mowrer, Palma, & Sanger offer the following hypothesis in 
this connection 

In human beings voice is under exquisite voluntary control How, we m2,y 
ask, did proto-man ever secure the safety from predators needed to allow 
this function to pass from instinctive control over into the realm of re- 
sponses which are controlled by individual learning^ 

® Howard’s highly original study (1920) of the use of song by birds to establish 
“territoriality” warrants perhaps another category See also the observauons of 
Tinbergen (1953) reported in Chapter 10, Section II 
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Without proposing in any sense to exhaust the possible answers to this 
question, we wish to suggest one line of thought and briefly indicate some 
of the relevant evidence We know that birds and arboreal primates are the 
most vocal of living creatures Only birds and monkeys are said to “chatter ” 
What do they have in common^ In the one case by flight and in the other 
case by specialized climbing skills, they have both escaped the dangers that 
beset terrestrial mammals They alone seem to have attained enough se- 
curity so that It does not matter if they are “noisy,” and only with such 
security does it seem possible for the enormous experimentation to occur 
which must have been the precursor of articulate speech 

By this route we are led to the conclusion that man, as a speaking ter- 
restrial mammal, could have evolved as such only as a result of having 
spent a protracted period of time “in the trees ” Whether we wish to call 
the first creature with articulate speech “man” is perhaps a debatable ques- 
tion, but there appear to be good grounds for suspecting that man, or his 
immediate ancestor, was already “talking,” or at least capable of it, when 
he descended from the trees and became an earth-dweller Man seems to 
have survived on the ground by virtue of peculiar vocal, intellectual, and 
manipulative skills which developed in connection with arboreal life and 
which made possible the development of a considerable degree of social 
integration and perhaps an impressive “culture” before he could hazard 
existence on the ground Some anthropologists believe that human culture, 
in the complexity which we find in even the most primitive contemporary 
peoples, could never have developed in a tree-dwelling species, but this 
is not to say that man may not have had an excellent start as a talking and 
culture-bearing organism before becoming able to exploit the advantages, as 
well as cope with the dangers, of a terrestrial habitat 

These, of course, are highly speculative thoughts, but thoughts to which 
our initial laboratory observations seem not unreasonably to lead us (pp 
38-42) 

The foregoing analysis leaves some questions unanswered Why, for 
example, have not the birds developed a form of communication com- 
parable to human language^ As we have seen (Chapter 3), many avian 
species are quite capable of reproducing human words, but they do not 
seem able to zise them in the same way This may be because birds, in 
order to fly, have sacrificed the possibility of developing hazids, and 
perhaps only a handed creature can develop a technology and culture 
in which fully articulate speech becomes highly functional But mon- 
keys and apes have hands quite as good as our own, and their oral and 
vocal equipment seems completely adequate for speech Why have 
they not developed linguistically, beyond the few stereotyped sounds 
previously discussed^^ Here one can only surmise that the remarkable 
mutation with respect to the “speech centers” of the brain which mani- 
festly took place in the evolutionary line from which man has de- 
scended did not occur in these species 
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III Signaling and Quasi-Predication 

As later sections of this chapter will show, predication is the most 
distinctive feature of human language It seems not to occur in infra- 
human organisms, and it takes quite some time for it to make its ap- 
pearance in the human infant (see Section V), despite its continuous 
occurrence in the infant’s social environment At the same time, there 
IS something similar to be found in lower animals which is highly in- 
structive, namely what may be called quasi-^predi cation 

In the preceding section we have seen that most of the signaling 
reactions made by lower ammals have an instinctive, emotional, non- 
voluntary basis Thus there are danger and distress cries, snarls and 
growls of warning, sex calls, food calls, and, very likely, not much else, 
and these signals, such as they are, are largely if not wholly intended 
for mtraspecies consumption But how, precisely, do they operate^ 

If It be granted that the making of the signaling responses is instinc- 
tive rather than learned (it seems that natuie could not depend upon 
the chancy learning of such important social actions), the principal 
remaining question is how the response to these sources of stimuli is 
acquired As we shall see presently, there seem to be some instances in 
which these stimuli are not only made but also reacted to instinctively, 
but a simpler and more instructive situation is one in which the mean- 
ing of a signal has to be learned If an older dog and a pup are fed from 
the same bowl, the pup will at first innocently and brashly rush up to 
the bowl, along with the older dog, as soon as food is put into it The 
older dog, having no inclination to share the food until his own hunger 
has been allayed, will resent the pup’s intrusion, growl at him, to no 
avail, and then, likely as not, mp him After a few repetitions of this 
sequence, the growl alone is enough to keep the pup at a respectful 
distance, and, eventually, the mere sight of the situation (older dog 
eating from bowl) m which the pup has been growled at and, on 
occasion, mpped will have the same effect 

There is, of course, nothing either novel or particularly instructive 
m the foregoing illustration, since it is readily interpretable on the basis 
of well-known principles But let us consider an extension of the illus- 
tration Suppose the older dog is jealous of his relationship with his 
master and that whenever he sees the pup making friendly, affectionate 
overtures to him, the older dog growls If the master does not inter- 
vene and silence the older dog, it is quite possible that the pup will 
become afraid of the master^ not because of any mistreatment or pun- 
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ishment he has received from the master himself but because he has 
been conditioned to fear, or at least to fear approaching, him by means 
of a mere signal (or "‘^warning'') from the older dog 

Here again, in terms of principles, there is nothing new — merely an 
instance, we would say, of second-order conditioning But the situation 
is nevertheless interesting, for we see in it a rudimentary example of 
“teaching” or “instruction” by means of a signal By associating, in the 
pup’s experience, sight of master and sound of growl, the older dog 
can change the pup’s attitude and behavior towaid the master in a 
quite significant way Here we have quasi-^rtAic^xion By this is meant 
that the subject of a “sentence” is physically present (“understood”), 
with only the predicate symbolized, verbalized The “predicate” 
(growl) is, a half-sentence, which carries the “message,” (Master) 
IS dangerous As it happens this sentence is not “true,” in that the 
master (presumably) is not dangerous, but if the pup saw the master 
only in the presence of the older dog and had no opportunity to 
“reality-test” (i e , to extinguish his fear) in another situation (and 
thus discriminate between master- with- and master- without-oldei -dog- 
present), the sentence would be true for him — and serves, perhaps all 
the better, to suggest how “language” operates 

Many other examples of the same sort of phenomenon could, of 
course, be cited When a mother hen, sighting a soaring hawk in the 
sky, gives (instinctively^) her long, shrill alaim cry and her chicks 
react (instinctively^) with fear and flight, conditions are right for 
them to learn that (Hawk) is dangerous To the extent that they 
have perceived the hawk when the alarm cry sounds, they will come 
to react to sight of hawk much as they do to sound of the hen’s dis- 
tinctive cry Or, when the hen finds food, she gives a series of quick 
“chirps,” which serve to call the chicks to the location of the food 
and presumably help them later to recognize and locate edible sub- 
stances on their own 

Or, at the human level, we see much the same sort of thing occuiimg 
as a result of the use of so-called “one-word sentences ” After cer- 

^Hardey, a British zoologist, has recently (1950) reviewed a number of studies 
on the reactions of hand-reared wild birds to predator birds of various kinds and 
concludes, on the basis of this evidence, “that the process of recognition by a con- 
figuration of Msual clues is innate” (p 335) And the present writer has observed 
that myna birds which have been taken as nestlings and thereafter reared in cap- 
tivity are instantly alerted and often thrown into apparent panic by the sight of 
any soaring object in the sky Perhaps the common chicken, through its long 
domestication, has lost some of this instinctive wisdom and (like man) has to 
be individually “instructed ” 
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tain sounds, such as “No, no,” “Stop,” “Hot, hot,” “Come,” “Nice, 
nice,” have through conditioning acquired meaning for a child, they 
can be associated with persons, things, or situations which are physi- 
cally present, and the result is that the child’s attitude and behavior 
toward the latter is changed, without any direct experience therewith 
which would justify the change In other words, by means of such 
signs or signals, the person making them can “go between” the child 
and certain inherently painful or pleasurable experiences in such a way 
as to dispose the child either to avoid or to seek such experiences Here 
learning is vicarious or mediated (see Chapter 2), which is one of the 
hallmarks of “language ” 

But thus far, in all the examples given, there has been a serious 
limitation the “subject” of the so-called sentence has been in some 
sense present rather than re-present-ed Only when the subject, as well 
as the predicate, of a sentence is representational or symbolic can we 
say that we have language in its fully developed, fully “articulate” 
form, and this is a level of achievement apparently found nowhere in 
the animal world 

But perhaps the illustrations cited do not do full justice to language in 
animals Perhaps other species are more accomplished in this regard Since 
language and social development are often linked together, perhaps the 
so-called “social insects” have transcended the limitations which we have 
just noted Fortunately, Karl von Frisch (1950) has meticulously studied 
and beautifully described for us what he calls the “language” of bees In 
reportmg on an experiment m which sugar water is placed a few meters 
from a bee hive with special provision for observing activity in the hive, 
von Frisch says that it takes some little while before the first bee locates 
the sweetened water Then bees, all from the same hive, shortly start ar- 
rivmg in large number “Evidently,” says von Frisch, “this bee must have 
announced its discovery at home” (p 53) How, precisely, is this done^ 
Von Frisch continues 

“After she has returned to the hive, our marked bee is first seen to deliver 
most of the sugar-voater to other bees Then she begins to perform what I 
have called a round dance” (p 55, italics added) 

“During the dance, the bees near the dancer become greatly excited, 
they troop behind her as she circles, keeping their antennae close to her 
body Suddenly one of them turns away and leaves the hive Others do like- 
wise, and soon some of these bees appear at the feeding place After they 
have returned home they dance, and the more bees there are dancing in the 
hive, the more appear at the feeding place It is clear that the dance inside 
the hive reports the existence of food” (p 56) (Mowrer, 1954, p 674) 

Later investigation showed that the round dance is used by bees to 
indicate the presence of food within a radius of 50 to 100 meters from 
the hive, without reference to direction It is, in short, an invitation or 
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command to go out and ''cruise” around the hive Food sources beyond 
100 meters, on the other hand, are reported by means of what von 
Frisch calls "wagging dances,” which indicate, apparently with con- 
siderable precision, both distance and direction Here we shall not be 
concerned with the intricacies of the latter, but rather with the fact 
that in both the round dance and the wagging dance, the returning bee 
brings some of the newly discovered food and distributes it to other 
bees This behavior is of special importance for purposes of language 
analysis, for it suggests that, for all its ability to execute sentence 
predicates, sometimes of remarkable complexity, the bee has no signs 
for sentence subjects and has to use a bit of the thing itself for this 
purpose Therefore, one may conclude that even the industrious and 
ingenious bee has not, in any basic sense, transcended other animals 
with respect to language function it, too, is limited to "sentences” of 
the thing-sign variety And experiments either conducted or cited by 
Schneirla (1950) with the ant show that here, despite the intricacy of 
social organization, "language” is even less highly developed than in 
the bee However, it should be noted that the distribution of bits of the 
sugar water to other bees in the home hive is a sort of "representation” 
and is only one step removed, obviously, from "true” predication 

But what of the "talking birds”^ There are many authentic instances 
of parrots, parakeets, or myna birds learmng to say "complete sen- 
tences” and even reciting short poems For example, in a phonograph 
record obtainable from Mr and Mrs G William Smith, Hickman 
Mills, Missouri, one can hear a talented parakeet, "Blueboy,” reciting 
the first stanza of "Mary Had a Little Lamb ” Here, in terms of physi- 
cal sounds, we have three relatively long sentences which are lin- 
guistically complete But it seems most unlikely that "Its fleece was 
white as snow,” means to "Blueboy” anything like what it means to 
us In other words, although parakeets and many other types of birds 
are capable of learning to "parrot” long verbal sequences, there is no 
indication that they are doing anything more than amusing themselves 
or trying to entertain and thus keep close to them some beloved 
human being 

In summary, then, we may say that although the phenomenon of 
quasi-predication occurs among infrahuman organisms, true predi- 
cation — which is the genius and hallmark of human language — does 
not (cf Cassirer, 1944) However, our analysis of the former provides 
a solid underpinning of the understanding of the latter, as it will be 
depicted in the next section 
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IV From Signals to Sentences 
(True Predication) ' 

Since the actual historical origin of language is lost beyond any hope 
of ieco\erv, ue aie left with only more or less plausible surmises, or 
fictions The follow mg one has the advantage of giving us, by implica- 
tion, also a good working defimtion of language In his book, 

All Autobiography^ George Stewart (1946), Professor of English at the 
University of (California, goes about the problem in this way He sup- 
poses that a sound like “Ouch” may have developed as a half-reflexive 
reaction to sudden pain And then, says Man, speaking autobiogiaph- 
ically 

After awhile, when a creature had as good a brain as mine, [such] sounds 
would be more standardized, and their meanings fitted to the situation Thus, 
“Ouch’” might be used playfully, when the individual felt no real pain, or 
It might warn a child not to pick up a bee (pp 31-32) 

x\gain, [says Man], something which could start more for playfulness 
than for “use” might soon come to be of value in other ways When the 
band was foraging, one of them might signal his position by calling “Coo’” 
like a do've, to let the others know where he was 

Eventually came the union of the noun-idea and the verb-idea It may be 
that a woman came back without her companion, and much troubled All 
attempts at gesture failed to tell what had happened In desperation, naturally 
enough and yet with a stroke of genius, she cried, “Coo-ouch’” Then they 
knew that he who was called Coo had been taken with a sudden pain Such 
a combination of two ideas was more than mere expression of personal 
feeling, and more also than mere pointing-out of an mdividual It was the 
setting of two ideas into a new relation, and thus the beginning of real 
language (pp 32-33) 

The foregoing passages are the relevant ones for our immediate pur- 
poses, but they are followed by a brief paragraph which must also be 
added 

I like to think that mothers may first have made and practiced language, 
and that for some generations the fathers still sat around merely grunting 
while the mothers chattered happily At least I notice that girl-babies are 
still quicker to speak than boy-babies, and that they grow up in general to 
be more fluent talkers ® Besides, there has always been m language a great 

^ This and the following sections are adapted from “The Psychologist Looks at 
Language” (Mo'wrer, 1954) 

° Stewart might also ha\e observed that women are still the first language teachers 
of both boy and girl infants On the basis of an analysis of language published else- 
where (Mowrer, 1950, Chapter 24), it seems likely that very few, if any, children 
learn to speak from their fathers, save m the most exceptional circumstances See 
Thompson (1952, pp 366-367) 
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deal of an illogical and emotional quality I might say, “Women in\ented 
language, but men invented grammar” (p 33) 

With the male ego thus saved, let us return to our inquiry What 
Professor Stewart has done heie, following Grace De Laguna (1927) 
and others, is to make the phenomenon of predication^ 1 e , the com- 
bination of two (or more) signs into a so-called sentence, the bedrock 
of true language development Certainly anyone who has been present 
when a child starts, as we say, ''putting words together” knows what 
a momentous event it is The author will never forget when his own 
jgrst child, a little girl, met him at the door one evening and excitedly 
exclaimed "Pammy-kitty' Pammy-kitty'” He knew that his daughtei 
had visited a little neighbor, Pammy, that afternoon Therefore, 
“Pammy-kitty” clearly said, "Pammy (has a) kitten,” and the en- 
thusiasm which accompanied the statement also implied the qualifying 
clause, "which is really quite wonderful ” 

No, there can be no doubt that the act of putting words together 
in novel and informative combination is of enormous importance, both 
in the history of the race and in the development of each individual 
And the product, which we call the sentence, can usefully serve as the 
central fact in our definition and analysis of language However, an 
instructive complication at once arises, namely, the existence and 
relatively frequent use of the so-called one-word sentence, already 
alluded to ^ And with this w'^e are back where we started with single, 
noncombined signs 

It is certainly a commonplace observation that small children, well 
before they start speaking in formal sentences, communicate quite 
effectively — though, as we shall see, with definite limitations — by 
means of single words And even at the adult level, we often make 
single words function as full sentences, in what Skinner (1957) has 
called “mands,” 1 e , demands, commands, exclamations, etc But, if 
we look closely at these so-called one-word sentences, we discover an 
interesting characteristic, namely, that they always, or at least com- 

" Wyatt (i960) has noted and analyzed some 26 of the sentences first used bv a 
little girl whom she systematically observed She concluded “The first appear- 
ance of these phrases was quite striking At fifteen and a half months it seemed 
absolutely impossible for Nana to put words together Then suddenly, over- 
night, so to speak, the faculty to put words together or to produce two vv ords in 
succession, emerged (age sixteen months)” (p 29) 

® Web sterns New Collegiate Dictionary speaks of ^^full sentences^ as distinguished 
from minor sentences^ which generally consist of a completive word or phrase” 
(1951, p 771) Fowler says that where the subject or the predicate of a sentence 
IS “understood,” one has an “elliptical sentence” (1926, p 523) 
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In summary of our inquiry thus far, we may say, then, that the 
transition from the use of single signs to multisigns or sentences is, 
in some ways, insignificant but in other ways momentous It enables 
us to go from the concrete to the abstract, from the here-and-now 
to the “not here, not now ” Our next task is to clarify and expand this 
assumption and to indicate in more detail just how the grammatical 
unit or complex which we call the sentence works 

V Psychological Analysis of the Sentence 

In the preceding discussion we have asked, and in at least a pre- 
liminary way answered, the question What is the nature of a sen- 
tence^ We have tried, that is to say, to determine what sentences, 
scientifically considered, are In this section an attempt will be made 
to discover what sentences do^ i e , how they v^ork^ psychologically 
speaking 

There is a very widespread assumption, which we shall later have 
occasion to question, that in the process of spoken or written com- 
munication we, somehow, transfer meanings from mind to mind To 
communicate, it is suggested, is to make something common, shared, 
and this something is meaning, understanding, thought, knowledge, 

in the Old North Church of Boston) can be made to comey — or, perhaps more 
accurately, confirm — a highly complex message But such “code” stimuli, by their 
very nature, cannot be combined, in nonprearranged ways, with other signs, they 
thus fall outside the realm of language as we here conceive it 

There remains, however, an incidental problem which ought to be discussed 
in the present context in at least a preliminary way It pertains to the problem of 
the “parts of speech ” In the foregoing, we have made the subject-predicate rela- 
nonship, or “predication,” the essence of language And we have seen that this 
approach demands a minimum of two signs The question is Do these two signs, 
the so-called subject and predicate, differ in any intrinsic or scientifically mean- 
ingful way^ Subjects are commonly thought of as “nouns” and predicates as 
“verbs” And it is certainly true that, in English — ^with the exception of words 
like “murder,” “table,” and “bridge,” which can be either a noun or a verb 
— ^we can often identify a word (if it is not some other “part of speech”) as one 
or the other However, no less a student of hnguistics than Whorf (1952, p d), 
on the basis of comparative data, questions the validity of the noun-verb dis- 
nnction, and several examples which will be given later in this chapter, as well 
as the “Pammy-kitty” sentence already cited, suggest that there is not a one-to-one 
relationship between subjects and “nouns” and predicates and “verbs” (see Mc- 
Carthy, 1954, p 530) If the general psychological approach to the phenomenon 
of language suggested in this chapter proves valid, it may provide a new frame 
of reference in which to re-examine the whole question of speech parts (Cf 
Fries, 1952, Chapters V-VIII, see also Section IV of this chapter ) 
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ideas, information One -unter puts the matter this way He says that 
language, broadly speaking, is characterized by a “transfer of mean- 
ing ” It is the device “by which men have conveyed significant mes- 
sages to one another since the dawn of history ’’ “Meamng may be 
transferred by devices that have nothing to do either with the spoken 
language or with its written counterpart, and this basic proposition 
few will be so hardy as to deny” (Pei, 1948, p 10) 

Another wTiter says 

When the da\ arrived on which one person could make such movements, 
gestures, or grimaces as would lead another person to avoid or to accept 
an object, that is to sav, when a meaning could be transferred to one mind 
from another, language was created (Griffith, 1924, pp 207-208) 

Yet another says 

The philosophy of language, we may then say, to begin with, is con- 
cerned with tJbe evaluation of language as a bearer of meanings^ as a 
medium of communication and as a sign or symbol of reality (Urban, 1939, 
P 37) 

And to this the same writer later adds 

On the question as to what linguistic fact is not, linguists are in general 
agreed They are also agreed upon what it is that constitutes positively lin- 
guistic fact The sme qua non of language is precisely the meamng of which 
the sounds, the motor processes and tactual sensations, are the bearers (p 66) 

The first of the writers just cited is a linguist, the second a psy- 
chologist, and the third a philosopher We thus see how widely ac- 
cepted IS the notion that the basic function of language is to transfer 
or bear meanings from person to person, from mind to mind 

It is not hard to understand how this conception of language has 
arisen, and, as we shall see later, there is a certain limited sense in which 
It is undoubtedly correct But in another, more basic sense, this notion 
seems to be wide of the mark and to have been a barrier to the de- 
velopment of a psychology of language with real “power ” 

” In Greenough and Kittredge’s book, Words and Their Ways in English Speech, 
published in 1906, we find the same general thesis formulated thus “Language is 
the expression of thought by means of words” (p 2) And even in Fries’ other- 
wise \ery adventurous book, The Structure of English An Introduction to the 
Construction! of English Sentences, published in 1952, we find the author saying 
that he does not “deny that the chief business of language is to communicate mean- 
ings of various kinds” (p 8) 

^Contemporary “information theory,” in the manner of Shannon & Weaver 
(1949) seems to be based, at least obliquely, upon the person-to-person-transfer-of- 
meaning nouon Perhaps this is why some of the original promise of the theory 
has not been fulfilled (see Section I) 
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Let us explore now, instead, the proposition that in communication 
are not transferring meamngs from person to person as much as we 
are transferring meanings from sign to sign within a given person, 
within a single mind Said a little differently, the suggestion is that in 
order for us to communicate effectively with another person, he must 
already have the meanings with which we shall be dealing and that in 
the communicative act we are, for the most part, merely changing the 
signs to which particular meamngs are attached, merely shifting or 
transferring meanings from one sign to another One person, by the 
use of appropriate words or other signs, can arouse, or “call up,” 
particular meanings in the mind of another person, but he does not 
“transfer” or implant them there The communicative act, in its most 
salient aspect, lies rather in the combination, juxtaposition, or association 
of the meanings thus aroused m 7 iovel, ^^informative'" ways 
A rudimentary sentence will illustrate this notion Let us assume 
that John is telling Charles that T om is a thief It is clear that for 
the intended effect to be produced by this sentence, Charles must al- 
ready know Tom and must know about thieves and thievery In other 
words, Charles must already have meanings attached to the words, 
Tom and thief What, then, is the function of the sentence, “Tom is 
a thief” ^ Most simply and most basically, it appears to be this “Thief” 
IS a sort of “unconditioned stimulus” — ^we shall later want to qualify 
this term, but for the moment it will suffice — a sort of “uncondi- 
tioned stimulus” which can be depended upon to call forth an internal 
reaction which can be translated into, or defined by, the phrase, “a 
person who cannot be trusted,” one who “takes things, steals ” When, 
therefore, we put the word, or sign, “Tom” in front of the sign 

‘Tom (IS a) thief " 

Fig 4-3 Diagram illustrating how the sentence, 

“Tom IS a thief,” can be recast in the vernacular 

of conditioning theory “thief" ^ 


“Tom" 


“thief,” as shown in Fig 4-3, we create a situation from which we can 
predict a fairly definite result On the basis of the familiar principle 

^Test there be any ambiguity about the identity of the particular Tom here 
referred to, let it be said that he is Tom, the Piper’s Son, of fable and song 
^Mn the above analysis the copula and indefinite article are omitted on the 
assumption that, in a present indicative sentence, they are really unessential Sup- 
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of conditioning, would expect that some of the reaction evoked 
by the second sign, “thief,” would be shifted to the first sign, “Tom,” 
so that Charles, the hearer of the sentence, would thereafter respond 
to the word, “Tom,” some'what as he had previously responded to the 
word, ''thief ” Thus, in the Stewart example of the prehistoric woman 
saying “Coo-ouch,” some of the quality of “ouchness” presumably 
gets attached to the word, “Coo,” and in the case of the little girl 
saying “Pammy-kitty,” the hearer likewise comes to make some part 
of the “kitty” reaction to “Pammy ” 

Although the notion that the essence of language involves predica- 
tion, 1 e , the temporal conjunction of something called a subject with 
something called a predicate, is ancient and widespread,^^ there has 
recently been considerable tendency to replace it with the view that 
single words and sentences do not diStr basically In their book. The 
Meaning of Meaning (1923), Ogden & Richards, while accepting the 
hypothesis that words arouse but do not “convey” or “bear” mean- 
ings,^® nevertheless take the position that a sentence is just a complex 
sign They say 

port for this position is provided by the following excerpts from a recent letter 
from Professor Gregory Razran He says “The Russian equivalent of the English, 
‘I am a thief,’ is ‘Ya \or’ The copula is always omitted in modern Russian 
in the present indicame, but is not omitted in Czech and Polish The copula 'was 
not omitted in Old Slavic Yet it would be incorrect to attribute such omissions 
to modern developments, since such copulas are also absent in ancient Hebrew 
Moreo\er, such copulas may also be omitted in Latin and Sanskrit (one may 
say in Latin, ‘Ego fur sum,’ as well as, for emphasis, ‘Ego fur’) As far as I know, 
Slavic languages ha\e neither a definite nor an indefinite article, while Hebrew 
has a definite but not an indefinite article The indefimte article in Teutonic and 
Romance languages seems to have developed from ‘one,’ as notice their identity 
in German, French, Spamsh, and Italian, and, I believe, also in Old English How- 
ever, there is the differentiation of ‘a’ and ‘an’ from ‘one’ in modern English” 
(A foreign student also reports that in modern Turkish one would not say “Tom 
IS a thief” but merely “Tom thief,” ^Tom hirsiz ”) 

^“Thus Sapir is voicing a view very prevalent among philologists, when he 
writes, ‘There must be something to talk about and something must be said about 
this subject of discourse once it is selected The subject of discourse is a 
noun No language wholly fails to distinguish noun and verb” (Ogden & 
Richards, 1923, p 260) “For centuries it has been insisted that, for completeness, 
e\ ery sentence must have a word ‘asserting’ or ‘saying something’ about that person, 
place or thing There must be a ‘subject’ and a ‘predicate’ ” (Fries, 1952, p 14) 
^“Malinowski (1938) wrote an essay entitled “The Problem of Meaning in 
Primmve Languages” which Ogden and Richards published as part of their book 
and which Osgood, in discussing the notion that words “carry” meanings from 
person to person, evaluates as follows “Malinowski aptly dubbed this naive con- 
ception the ‘bucket theory’ of meaning— words like little buckets are assumed 
to pick up their loads of meaning in one mind, carry them across intervening 
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Thus the reference of “larks sing,” since it has two components, will 
diifer from that of “larks” just as do “soaring larks” or “lark pie,” being 
also dual references This difference is therefore unessential, though most 
complex references do in fact use the propositional form (p 259) 

In his Sig 7 is, Language, and Behavior, Morris (1946) says 

The fifth criterion requires that language signs be combinable with each 
other in certain ways, and not in others, and that these combinations form 
a complex sign Hull has suggested that such combinations are to be 
explained in terms of simultaneous and temporal stimulus patterning, since 
“ In reading, each letter is a complex visual pattern, each word is a 
complex pattern of these letter patterns, and each sentence is a temporally 
patterned sequence of printed word patterns” (p 58) 

And more recent and more explicit still is the following formulation 
by Dollard & Miller (1950) 

As has already been pointed out, a person can learn to respond to specific 
combinations of stimuli or relationships among them and to make different 
responses to the same cues in different contexts This is called patterning A 
person’s responses to the words that he hears someone else speak obviously 
involve patterning Thus a parent will respond quite differently to the 
following two reports containing the same words in different sequences 
“Jim hit Mary” and “Mary hit Jim ” This is an exceedingly simple example 
Although scarcely a beginmng has been made toward the study of language 
from the point of view of learning theory, it is obvious that man’s great 
innate capacity and rigorous social training have produced marvelously 
intricate and subtle patterning in his responses to spoken language (p 100) 

The notion under examination in this chapter is different It is that 
the sentence is, pre-eminently, a conditioning device, and that its chief 

space, and dump them in another mind ‘This attitude in which the word is re- 
garded as a real entity, containing its meaning as a Soul-box contains the spiritual 
part of a person or thing, is shown to be derived from the primitive, magical uses 
of language and to reach right into the most important and influential systems of 
metaphysics Meaning, the real “essence” of a word, achieves thus Real Existence 
in Plato’s realm of Ideas ’ ” (Osgood, 1953, p 680) 

^"The notion that language is merely a form of interpersonal stimulation and 
response is undoubtedly a product of the era of Behaviorism, and it achieved one 
of Its earliest, clearest, and most influential formulations in the writings of Bloom- 
field (see Section I) Here the recipient of the speech stimulation is what Court- 
ney (1949), in discussing the child-mother relationship, has called a “mediator” 
(not to be confused with “mediating response,” Section VI) (Perhaps “mter- 
mediatary” would be a better term) While widely accepted (see Fries, 1952, 
Chapter III), this conception of language seems greatly oversimplified it ignores 
the phenomenon of predication (by making a sentence basically the same as a 
stimulus) and bypasses the whole problem of meaning, knowledge, information, 
1 e , mediate as opposed to immediate behavior, predispositions to action as op- 
posed to direct response 
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effect IS to produce new associations, new^ learning, just as any other 
paired presentation of stimuli may do This position is congruent with 
the traditional notion that predication is the essence of language and 
may indicate, perhaps more precisely than purely linguistic research 
has done, the basic nature of this phenomenon 
This notion is presented here m a frankly exploratory mannei, as a 
hypothesis which others are invited to consider and test against the 
prevailing concepts and facts of their particular specialties So far as 
the WTiter has been able to determine, no similar conception of the 
sentence has been previously put forward In their otherwise il- 
luminating discussions of language, Russell (1948, see especially Chap- 
ter VI), Cassirer (1944, see Chapter VIII), Skinner (1957, Chapter 
14), and Carroll (1953) make no allusion to such a notion, although 
many of the linguistic phenomena to which they refer go unexplained 
for lack of it Because of the special promise of this hypothesis, the 
next tw^o sections will be concerned with its further analysis and 
elaboration, with special reference to the problem of mediation and a 
laboratory analogue 

^®The has recently discovered a very closely related, but unelaborated, 

conception of the communicative process In a paper by Carpenter (1953), en- 
titled “A Theoretical Orientation for Instructional Film Research,” there is brief 
reference to the “releasor-organizer hypothesis,” which is “that the signals, signs, 
and symbols of sound motion pictures function principally as releasors and or- 
ganizers of meanings and responses in human subjects” (p 42) The releasing 
function of signs is said to be “both dependent (or interdependent) on the stimu- 
lation and on the activated brain process (‘engrams’) of the experiencing subjects 
Thus, It may be reasoned that the functions of signals, signs, and symbols is to 
release responses m subjects Signs and symbols do not transmit meanings, 
they release meaning when and only when the subjects respond The charac- 
teristics of these responses relate closely to personal life history differences” (pp 
42-43) The same author continues “The releasor concept of signs and symbols 
must be supplemented by the related organizer concept Previously learned ‘en- 
grams’ may be modified by new snmulaaon, and even new related elements may 
be ‘imprinted’ New relationships may be shown, and old responses modified, by 
film-mediated stimulation The results are conceived to consist principally of the 
re-organizatton of previously learned neural-organic patterns which intervene be- 
tween film stimulaaon and the subsequent actions or reactions of the individual” 
(p 43) The notion that signs release, or arouse, meanings m rather than “bear” 
them to another individual, as stated by Carpenter, is identical with the position 
taken in the present analysis The “organizer” conception, while stated in some- 
what different terms, is also believed to be essentially congruent, at a relatively 
abstract level, with the theory of sentence function as here developed Whether 
the notion of “re-orgamzation” can, without injustice, be analyzed in terms of 
conditioning and mediation (see next section), or whether more holistic prin- 
ciples are required, is uncertain 
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VI The Problem of Mediation 

Perhaps the most generally accepted criterion as to whether a sen- 
tence has or has not done its work is this If, as a result of hearing or 
reading a sentence, an individual’s behavior, on some future occasion, 
with respect to some person, thing, or event not present when the 
sentence occurred, is Afferent from what it would otherwise have 
been, then that sentence may be said to have been “understood” and 
to have functioned effectively If, for example, John tells Charles, in 
the absence of Tom, that Tom is a thief and if, when Charles subse- 
quently encounters Tom, he reacts toward Tom with distrust and 
apprehension, communication has clearly taken place 

But this criterion of linguistic action poses an interesting problem 
for the behavioral scientist Everyone is familiar with situations in 
which an organism learns, or is taught, to leact to a sign more or less 
as if It were the thing or event signified In the vernacular of the con- 
ditioning laboratory, the organism, after conjoint exposure to the 
conditioned stimulus and the unconditioned stimulus, reacts to the CS 
somewhat as if it were the UnCS Or, as we may equivalently say, 
the meaning of the UnCS “moves forward” and becomes anticipatory 

This phenomenon seems to occur in language, true enough, as when 
the preicate meaning of a sentence “moves forward” and gets con- 
nected to the sentence subject But in language something else, of a 
different nature, is also involved This is the remarkable, and indeed 
somewhat paradoxical, phenomenon of an organism, after exposure to 
a sentence, reacting to some thing, event, or person as if it were the 
corresponding sign or symbol which was the subject of the sentence 
In other words, the new meaning attached, by means of predication, 
to the sign constituting the subject of a sentence has a tendency to 
shift or transfer “back,” so to say, to the thing, event, or person which 
the subject of the sentence represents, or “stands for ” This phenom- 
enon — sometimes referred to as semantic generalization — has received 
comparatively little attention but can be satisfactorily accounted for 
on the basis of well-known pimciples (see Chapter 2) 

Let us note, first of all, that what we are positing here is something 
quite different from so-called backward conditioning This is fortu- 
nate, for backward conditioning is a questionable, controversial type 
of event (Mowrer, i960. Chapter 10), whereas the phenomenon with 
which we are here concerned seems, as phenomenon, not to be in the 
least questionable We are, however, in need of a precise explanation 
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Let us begin by making a more detailed diagrammatic analysis of the 
sentence, “Tom is a thief ” In Fig 4-3 we have already seen how the 
familiar principle of conditioning can explain the fact that some part 
of the reaction evoked by the word “thief” gets connected to the word 
“Tom,” but we have not as yet said anything about the sequence of 
events whereby “Tom” and “thief” originally acquired their meanings 


"Tom” 


Tom 


“Rt 


Fig 4-4 Schematic indication of the way in which 
the word “Tom,” through the process of condition- 
ing, comes to denote, mean, or imply a certain per- 
son, Tom 


“Tom” r-,. 

As Fig 4-4 shows, the word “Tom” acquired its meaning, pre- 
sumably, by being associated with, and occurring m the context of, 
Tom as a real person Tom himself has elicited in John and Charles 
and others who have had first-hand contact with him a total reaction 
which we can label, Rt, of which Tt is a component And as a result 
of the paired presentation or concurrence of “Tom”-the-word and 
Tom-the-person, the component, or “detachable,” reaction, Tt, is 
shifted from the latter to the former 

"thief” 

Fig 4-5 Replication of Fig 4-4, showing how the 
thief Rt word “thief,” acquires its distinctive meaning 


"thief q 

And similarly for the word “thief” As indicated in Fig 4-5, this 
word is likewise presumed to have acquired its distinctive meamng by 
having been used in the presence of, or to have been, as we say, “as- 
sociated with,” actual thieves Therefore, when we make the sentence, 
“Tom (is a) thief,” it is in no way surprising or incomprehensible 
that the rt reaction gets shifted, as originally shown in Fig 4-3, from 
the word, “thief,” to the word, “Tom ” This is seemingly a straight- 
forward instance of second-order conditioning By first-order con- 
ditioning some part of the total reaction elicited by real thieves is 
shifted to the word, “thief”, and by second-order conditioning of the 
type provided by the sentence, this same reaction, with some attenu- 
ation or weakening, gets further transferred or shifted to the word 
“Tom ” 
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Our analysis thus far is, however, either incomplete or faulty, for if 
language worked precisely as suggested, it would pretty obviously not 
do what we want it to do and what, a good deal of the time, it mani- 
festly does If language worked as thus far indicated, the sentence, 
‘Tom IS a thief,” would serve merely to change the meaning of 
so that when Charles, as the recipient of this sentence, subsequently 
heard this word, it would remind him less or perhaps not at all of 
Tom but rather of thieves It would, in other words, become just a 
synonym for the word, “thief,” and we would have simply an instance 
of reconditioning or “redefinition,” a procedure whereby the noise, 
“Tom,” would lose its old meaning and acquire a new, different one 
This type of conditioning, or reconditiomng, would, pretty obviously, 
not serve our commumcative needs at all and would soon lead to utter 
chaos Clearly, something essential is missing here, fortunately, the 
difhculty can be quickly remedied 
In drawing a diagram of conventional type to represent conditioned- 
response learning, we are likely to represent the UnCS and the re- 
sponse It elicits and then, m adding the CS, to say something like this 
“This is an originally neutral stimulus Oh, to be sure, it probably 
evokes some reaction, but for our purposes it is not important ” Thus 
we end with a drawing something like that shown in Fig 4-6 


Fig 4-6 Conventional conditioning diagram, in- 
dicating the common neglect of the reaction orig- 
inally produced by the conditioned stimulus 


R’ 


UnCS —UnCR 


But if we are to succeed in making conditioning theory account for 
the basic facts of language, we must proceed a little differently at this 
point As already indicated, particularly in Fig 4-3, the subject, or 
“CS,” in our specimen sentence has, by assumption, a very definite 
reaction potential or meaning, which we have designated as Tt Let us, 
therefore, ledraw Fig 4-3, but, instead of ignoring Tt, let us give it 
rightful recognition in the diagram Figure 4-7 is the result 
Assuming now, as we reasonably may, that the “Tom” — r^ con- 

^®It may be helpful to think of the Rt reacnon, mentioned above, and the so- 
called “detachable component,” tt, as analogous, respectively, to the total reaction 
produced by an electric shock m a rat and the reaction produced by a stimulus 
which is merely a sign of shock Shock produces sensations of pain, fear, and 
physical agitation, but it is only the fear that gets conditioned, or “detached,” 
and occurs anticipatorily, to a mere signal or sign of shock (See also Chapter 5 ) 
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nection is a relatively stable one, we will expect the conditioning out- 
come sho’v\ n at the bottom of Fig 4-7 Instead of rt, the thief -meaning, 
getting connected directly to the word, “Tom,” and more or less 
replacing the rT reaction, we may infer that rt will be condi- 
tioned rather to the reaction — or, more accurately, to the stimuli or 
sensations produced by the reaction — ^y^hich the word “Tom” pro- 
duces, namely rT This internal reaction, or meaning, thus becomes 
what Lumsdaine (1939), Foley and Gofer (1943), Osgood (1953), 
and others have recently called a mediating response (see Chapter 2), 
and Its importance is indicated by the felicity with which it delivers us 
from the difficulties into which a too simple, too abbreviated analysis 
of language in terms of conditioning plunges us 

"Tom (is a) thief” 

"Tom” — r-j- 

Fig 4-7 Replication of Fig 4-3, but with the medi- 
*'thief ” ^ rj ating response, tt, included rather than omitted 


“Tom” Tj 

We have already posited (Fig 4-3) that the meaning reaction, Tt, 
which gets connected to the word, “Tom,” is a component of Rt, 
which is the reaction or reaction complex evoked by Tom himself, 
and we have also posited (Fig 4-7) that the sentence, “Tom (is a) 
thief,” will cause the thief-meamng, rt, to get connected to rT There- 
fore, when Tom-the-person is subsequently encountered by Charles, 
Tom will elicit in Charles the Rt reaction, of which rT is a part, which 
will in turn elicit the thief-meamng, rt Q E D This mechanism for 
the occurrence of semantic generalization or meamng transfer from 
sign to thing is shown schematically in Fig 4--8 and is characterized 

"Tom” ft 

Fig 4-8 Indication of how tt, m the example given, 
functions as a “mediating response” (Cf Figs 4-3 

(r^-) rj and 4-7) 

Tom Rj 

by relative simplicity yet also possesses, seemingly, considerable gen- 
erality and explanatory vigor 

“Interestingly enough, this hypothesis has at least verbal similarity to the 
“identical-elements” theory of “transfer of training” as advanced by Thorndike 
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If our specimen sentence worked as Fig 4-3 implies, 1 e , if the 
tluef-meamng, rt, got conditioned directly to the word, “Tom,” and 
thus more or less replaced the Tom-meaning, Tt, then there would be 
only one apparent way in which the thief-meamng could get trans- 
ferred to Tom as a person, namely for Tom-the-person, when en- 
countered, to elicit in Charles a labelmg reactto?i, which would involve 
his saying, at least subvocally, the word, “Tom,” which m turn would 
then elicit the thief-meamng, rt (see Fig 4-9) While this hypothesis 

Fig 4-9 A possible, but not entirely satisfactory, «‘Xom' 
conception of how a meaning acquired by a word 
(“Tom”) can get transferred to the thing or per- 
son (Tom) represented by the word Tom 

IS logically tenable and may in some cases correspond to reality, it has, 
as will be shown in the next section, rather limited applicability Adore- 
over, as we have seen (Figs 4-7 and 4-8), the type of mediation 
mechanism already posited takes care of the known facts very nicely, 
without entailing any of the limitations of the labeling hypothesis 

Vll Further Analysis of the Sentence as a 
Conditioning Device 

The essence of the argument advanced up to this point is that the 
subject-predicate complex which we call a sentence is, in effect, simply 
an arrangement for conditiomng the meamng reaction produced by 
the predicate to the interoceptive stimulation aroused by the meaning 
reaction elicited by the sentence subject The following laboratory 

(1925) and others A mediating reaction, such as ra in the above example, is 
an “identical element” in the reaction produced by both the word, “Tom,” and 
the person, Tom Therefore, if, by means of the Tom-is-a-thief sentence, we 
get a new meaning-reaction, rt, conditioned to it as ehcited by the word, “Tom,” 
we will expect it to generalize to it as elicited (m the context of the total Rt) 
by the person, Tom 

“^Bollard & Miller (1950, see especially Chapter VI) have developed in con- 
siderable detail the notion of response generalization and transfer (as well as 
discrimination) through “labeling ” However, they agree that such generalization 
may occur on the basis of “labeling or other cue-producmg-responses” (p 105) 
Thus they do not exclude as a possibility the mechamsm which is to be emphasized 
in the following discussion See also Chapter 2, Section VI 

Since this statement was written, Staats, Staats & Heard (1959) ha\e reported 
a direct experimental confirmation of this hypothesis They say “The hypothesis 
that a meaning response can be conditioned to a meaning response was sub- 
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paradigms w ill help put this w ay of thinking about language function 
into a broader, more systematic perspective and, at the same time, will 
provide a summary of this chapter as a whole 

Let us assume that our objective is to tram a rat not to eat a certain 
preferred food Cheese is such a food for rats, which they will readily 
take even though fully satiated on such a well-balanced ration as 
Purina Laboratory Chow The most direct way, and the one to be first 
considered here, of teaching chow-satiated rats not to eat cheese is 
to punish them while in the process of eating or starting to eat the 
forbidden food It goes without saying that by using a harmless source 
of pain hke electric shock, it is possible in this way to make cheese 
Itself, as well as the actions involved in taking and eating it, so fear- 
producing that rats will turn away from it instead of moving toward 
and taking it This procedure for accomplishing a purely heuristic 
objective is represented diagrammatically m Fig 4-10 and is, of course, 
analogous to the practice, not uncommonly employed in child train- 
ing, of catching the child, as we say, “in the act” and admimstering 
some sort of primary punishment forthwith 



Fig 4-10 A “thing-thmg” conditioning 
sequence, or “sentence,” Re is the eating 
reaction elicited by the cheese (and 
hunger), and Rs is the total reaction 
elicited by the shock, of which rs is the 
“detachable component,” fear Since rs 
gets conditioned to Re (or, more ex- 
actly, to Its proprioceptive “backlash”), 
Re tends to become inhibited as shown 
in the lower line of the diagram (There 
IS also some fear conditioned to the 
cheese itself, but for simplicity of anal- 
ysis, this connection is not represented, 
and for present purposes is not relevant 
For support, derived from experimenta- 
tion with human subjects, for this land 
of analysis, see Razran, 1939b ) 


stantiated Thus, Mowrer’s conception that communication takes place by the 
meaning of the predicate becommg conditioned to the meaning of the subject 
IS given support The mediated conditioned meaning effect was sigmficant 
at the 005 level [of significance] It was concluded that meaning responses can 
enter into multi-link mediating chains of responses, without Ss’ awareness” (pp 
5-6) See also Staats & Staats (1957) 
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While the most direct and in some ways most efficient way of in- 
hibiting a particular form of behavior, the procedure just described — 
which we shall refer to as a thing-thmg sentence — is only one of four 
ways in which the same objective can, at least in principle, be achieved 


Tone^. 


Fig 4 -n Conventional procedure for conditioning 

a fear reaction, Ts, to tone Shock Rs 


Tone fg 

Suppose that we now take naive rats and first pair a tone with elec- 
tric shock a few times (Fig 4-1 1) Now let us present cheese and as 
the rat starts to take it, we sound the tone (Fig 4-12) This involves 
the use of what may be called secondary y or fear, punishment and 
will serve only a little less effectively than does primary punishment 
to inhibit the act with which it is associated A recent study by Bixen- 
stine (1956) shows that this means of controlling behavior can be used 
quite effectively with rats, and it is clearly parallel to the parental 
practice of warmng, or “speaking to,” a child when engaged, or about 
to engage, in some disapproved action This procedure may be con- 
vemently dubbed a thing-sign sentence 
Next there is a procedure which we may, m the same vein, call a 

Cheese 

Fig 4-12 Illustration of how cheese eating 
can be inhibited by paired presentation of 
cheese and a fear-elicitmg tone 

Cheese 

sign-th?ig sentence Suppose we have paired a blinking light several 
times with the presentation of cheese so that it elicits a confident 
“expectation” of cheese and appropriate anticipatory movements (Fig 
4-13) If the rat is placed on a grill-hke floor and if cheese is piesented 
vertically on the end of a stylus a little to one side of the rat and the 
blinking light is presented a few seconds in advance of the cheese, the 
rat will soon start making horizontal pendular, or “groping,” move- 
ments in anticipation of the presentation of the food (Albino and 


Tone • 
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therefore partially blind rats have been used in this study and are 
probably better, for this particular experiment, than rats with pig- 
mented eyes ) 


BL'- 


Cheese 



Fig 4-13 Procedure for getting a part (re) of the 
total eating reaction (Re) elicited by cheese condi- 
tioned to a blinking light (BL) 


Uv- tg 

A sharp discrimination between the experimental situation with and 
without the blinking light is necessary and is achieved by leaving the 
animals in the situation for relatively long periods of time between 
presentations of the blinking light and cheese In other words, the sign 
value of the experimental situation as such is thus thoroughly ex- 
tinguished For reasons to be mentioned shortly, such a clear-cut dis- 
crimination IS necessary m this type of investigation 

If we now present the blinking light, which elicits the “searching” 
or “groping” head movements, and follow it with shock, we will 
expect these movements to be pumshed and to be inhibited, as sug- 
gested in Fig 4-14^^ And since the same movements are part of the 


Fig 4-14 Procedure for getting fear at- 
tached to the anticipatory, food-seeking re- 
sponse (re), which IS produced by the 
blinking light (see Fig 4-13) 


total response called forth by cheese itself, we will expect this traimng 
to generalize to cheese, as shown m Fig 4-15 It will be seen that we 
are here employing exactly the same assumptions about the role of 
mediating reactions as advanced in earlier parts of this (and in the pre- 

^The reason, alluded to above, why the head movements need to be condi- 
tioned quite specifically to the situation-plus-blmking-light is that if they occur 
also with any frequency to the situation-alone, then any attempt to determine, 
in a control group, the effect of admimstermg a shock not combined with the 
BL would be invalidated an animal might be in the act of makmg the head 
movements, “spontaneously,” just as the shock came on, which would produce 
an effect not greatly different from that obtained where the BL and shock are 
paired 
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ceding) chapter and that the situation is parallel to one in which a 
parent reinstates verbally some form of misbehavior and then ad- 
ministers primary punishment 


Fig 4-15 Indication of how it is that in- 
hibitory tendencies acquired at the sym- 
bolic le\el (see top line) generalize, 
through the mediating response re, to 
the “reality” level (bottom line) 


Finally, we come to a procedure which parallels what is presumably 
involved in language proper, i e , m a sign-stgn sentence Let us assume 
that our subjects have had the kinds of training shown in Figs 4-11 
and 4-13 and then the kind shown in the upper part of Fig 4-16 The 
first behavioral result we would expect from this type of sign-sign 
conditioning is that the anticipatory, exploratory responses formerly 
elicited by the blinking light (re) will be inhibited (lower line. Fig 
4--16), because of the fear that has gotten attached to them And as a 
further consequence, we would expect this inhibitory effect to gen- 
eralize to the behavior produced by the thing represented by the 
blinking hght, namely cheese This would involve the now familiar 
mechamsm of response mediation, as already shown in Fig 4-15 
Exploratory experiments give empirical support for these inferences 

BL 

Fig 4-16 Diagram showing how fear (rs) 

IS connected, by a “sign-sign” sentence, to 
the anticipatory food reaction, re, and tends 
to inhibit It 

BL 

This paradigm seems to fulfill the ciiterion of true language By 
means of a two-sign complex, or sentence, namely BL-tone, we cause 
a living orgamsm to be so modified, in the absence of something 
(cheese), that when it later encounters that thing it behaves differently 
from the way it would have behaved without the intervening traimng 
The parallel to our earlier analysis of the Enghsh sentence, “Tom is a 
thief,” will be evident In both cases we see once again, and perhaps 
more clearly now, that what we call a sentence is basically a device 
for producing associative shifting, or conditiomng, but that in order 




Cheese Re 
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for the sentence completely to fulfill its intended function there must 
also be the phenomenon of response mediation (Fig 4-15), wheieby 
the new meaning which thus gets connected to the sentence subject 
can generalize, 01 transfer, to the thing thus symbolized 


VIH What, Then, Is a "Symbol''— and the Essence of Language^ 

After having the foregoing material presented to them in the class- 
room, students often ask '‘Now just what 2S a 'symbol’^” This is a fair 
question, and somewhere, surely, in a book on the symbolic processes, 
It ought to have a clear and explicit answer As it happens, however, 
our approach to this problem in the context of contemporary learning 
theory is still so new that thinking about it has not yet been fully 
consohdated An able young psychologist who read a preliminary 
draft of this chapter admirably high-lighted the situation as follows 

Since language is an area which learning theory has never dealt with 
very adequately, a fuller discussion of certain issues would be desirable It 
seems to me that the concept of mediation behavior is the key which opens 
up this field for learning theory and permits the solution of many pre- 
viously perplexing problems More attention should be given to the ways 
in which this approach differs from other approaches to language (such 
as that of Skinner) which do not assume mediational processes Also there 
are some distmct points of difference between this approach and that of 
other mediational theories, such as that of Osgood The Osgood formula, 
although assummg mediating stimuli and responses, still retains the Hullian 
conception of bonds or connections, and reinforcement is an operation for 
stren^hening them It is interesting that the most ambitious attempt 
by a philosopher to deal with the pragiJiatics of language (cf Morris’ Signs, 
Language, and Behavior, 1946) did not at all employ the mediational notion, 
but stayed close to the ideas of Hull and Tolman Bertrand Russell’s writings 
on language seem benighted with respect to learning theory 

It is possible that the key to understanding language lies in the develop- 
ment of mediation processes generally rather than in vocalization specifically 
Perhaps mediation processes evolved first, then only later speech and com- 
munication Consider an aggregation of near-human beings many of whom 
had developed little fragments of “thought” and symbolism, which were in 
various ways functional in their own behavior alone This would represent 
a sort of unstable situation which could be “triggered” into further rapid 
evolution, much as a super-saturated solution is triggered mto crystallization 
by a small stimulus As soon as a few vocalizations began to take on meaning, 
there would be a wholesale rush of meanmgs and ideas from one mdividual 
to another, the little fragments of thought would now be “shared,” resulting 
ultimately in culture 

In contrast to this evaluation of the role of mediation in understand- 
ing the nature of language is the disparaging view of Brown as set 
forth in his book. Words and Things (1958b) He says 
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What evidence is there for the existence of such fractional implicit re- 
sponses^ Jacobson’s work demonstrated that some words sometimes evoke 
implicit responses This study does not demonstrate that the implicit re- 
sponses are fractional components of reactions to stimulus objects that may 
be considered referents for the words used The evidence for actual con- 
ditionmg of fractional implicit reactions has all been obtained with autonomic 
reactions to shock or with salivation to food powder And there are good 
reasons to doubt that either of these is sufficiently covert and abbreviated 
to be a meaning There are many studies in which one or the other of these 
reactions has been conditioned to a number of different words If we were 
to take these responses for the meanings of the words it would follow that 
the words had been given identical meanmgs by this conditioning pro- 
cedure and that is patently absurd It is necessary to say that these responses 
are at most only a part of the total mediating reaction, the remainder of the 
reaction not having been observed in any of these studies In sum, there 
IS scarcely any direct evidence for the existence of mediating responses 
elicited by linguistic signs (p loi, italics added) 

Fmally, behavioral meanmgs are found cheek-by-jowl with imaginal 
meanmgs inside the organism — neither revealed m action nor available to 
mtrospection (p 102) 

The reason for this rejection of the concept of mediation (in the 
face of much empirical evidence not cited by Brown) becomes more 
apparent when one discovers that the author has immersed himself in 
formal hnguistics (probably more fully than any other American 
psychologist) and is operating within the slogan of that discipline 
“Language is a system” (viii) Here the central assumption, as Brown 
interprets it, is that an “utterance” (the term “sentence” is not in favor 
among hngmsts at present) consists of “systematic sign contingencies” 
(p 183) And as one reads further it emerges that this expression im- 
plies “configurational conditiomng” and “contextual dependency ” In 
short. Brown completely disregards the phenomenon of predication and 
has taken the position that an “utterance” is just a more or less complex 
combination of stimuli (cf Section V of this chapter) which human 
beings learn to make and to react to in accordance with the rules of 
the hnguistic system which is dominant in their particular society 
Once they have learned this system, they supposedly have a “disposi- 
tion” to know how to construct and interpret such utterances Says 
Brown 

It seems to me that when one comes to understand a linguistic form his 
nervous system is partially rewired (in the sense of changes in synaptic re- 
sistances or neurone process growth) so that one is disposed to behave ap- 
propriately with regard to that form For the psychologist [^] meaning is 
not a particular response It is the disposition to behave in varying ways 
with regard to the form as the contingent circumstances are changed The 
disposition has no substantial character other than the structure of the 
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nervous system It is not a learning, a beginmng, a miniature reaction It 
IS a response potential A disposition is discovered by creating various con- 
tingencies and observing responses 

Within a linguistic commumty there are standards (not necessarily formu- 
lated) for the usage of an utterance and for total behavior with reference 
to the utterance These standards define appropriate behavior, the con- 
ventional disposition A child bom mto the community does not at first 
conform to these standards, but he eventually does so and is then said to 
speak and understand the language 

I am satisfied that the disposition theory gives a more sensible account of 
linguistic meanmg than any variety of particular reaction theory (p 103) 

Although this brief excerpt may not do full justice to Brown’s thesis, 
It indicates the direction in which his approach points, and for reasons 
previously advanced in this chapter, it seems that this direction is not 
a promising one Brown’s analysis entirely by-passes the problem of 
predication and in so doing leaves no place for the concept of medi- 
ation, and when mediation is rejected, so also, apparently, is the heart 
of the problem of meaning (see Chapter 5) But the Brown book, 
despite Its theoretical bent, makes good reading and is, in many ways, 
highly informative 

As already noted, N E Miller has made some of the basic contribu- 
tions to our understanding of mediation, and in his 1950 book col- 
laboratively written with Dollard, there is considerable reference to 
this phenomenon Here the authors say 

In order to talk about the higher mental processes we need to make the 
distinction between instrumental and cue-producing responses (Hull, 1930b) 
An instrumental act is one whose mam function is to produce an immediate 
change m the relationship to the external environment Opening a door, 
liftmg a box, jumping back on the curb are examples of instrumental acts 
A cue-producmg response is one whose mam function is to produce a cue 
that IS part of the stimulus pattern leadmg to another response Counting 
[cf Chapter 2, p 62] is a cue-producmg response (p 98) 

And later Dollard & Miller continue 

Havmg made the distinction between instrumental and cue-producing 
responses, we can improve our description of the distinction between the 
“lower” and “higher” types of adjustment In the former, the instrumental 
response is made directly to the pattern of external cues and internal drives, 
m the latter, one or more cue-producing responses intervenes (p 100) 

But this distinction, useful as it is for some purposes, does not pro- 
vide the basis for the understanding we are now seeking Infrahuman 
orgamsms engage, not uncommonly, in “cue-producmg responses” 
(“pure-stimulus acts”), as has already been indicated in Chapter 2 and 
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will be further seen m Chapter 6 Such organisms do not, however, 
have language j and it is the defining characteristics of the latter that 
we are here trying to derive For Dollard & Miller this problem was 
still an unsolved one, as indicated by the following statement 

It should be noted that by emphasizing the hypothesis that verbal 
and other cue-producing responses play an essential role in the higher mental 
processes, nve are not denying the fact that the orgammi must possess certain 
capacities, the exact nature of which is still unknown, before such responses 
can operate in this way A parrot can learn to imitate words but not to be- 
come a greater thinker (p loi) 

IX The Views of Certain Philosophers 

In some ways the most seminal mind to deal with the problem of 
symbolism in this century was that of G H Adead, and the essence of 
his thought on this score is captured by the following quotation from 
his book. Mind, Self, and Society (1934) 

The sentinel of a herd is that member of the herd which is more sensitive 
to odor or sound than the others At the approach of danger, he starts to 
run earlier than the others, who then follow along, in virtue of a herding 
tendency to run together There is a social stimulus, a gesture, if you like, 
to which the other forms respond The first form gets the odor earlier and 
starts to run, and its starting to run is a stimulus to the others to run also 
It IS all external, there is no mental process mvolved The sentinel does not 
regard itself as the individual who is to give a signal, it just runs at a certain 
moment and so starts the others to run But with a mind, the animal that 
gives the signal also takes the attitude of the others who respond to it He 
knows what his signal means A man who calls “fire” would be able to call 
out in himself the reaction he calls out in the other In so far as the man 
can take the attitude of the other — his attitude of response to fire, his sense 
of terror — ^that response to his own cry is somethmg that makes his conduct 
a mental affair, as over agamst the conduct of the others But the only 
thing that has happened here is that what takes place externally in the herd 
has been imported into the conduct of the man There is the same signal 
and the same tendency to respond, but the man not only can give the 
signal but also can arouse m himself the attitude of the terrified escape, 
and through calling that out he can come back upon his own tendency to 
call out and can check it He can react upon himself in taking the organized 
attitude of the whole group in trying to escape from danger There is nothing 
more subjective about it than that the response to his own stimulus can 
be found in his own conduct, and that he can utilize the conversation of 
gestures that takes place to determine his own conduct If he can so act, 
he can set up a rational control, and thus make possible a far more highly 
organized society than otherwise The process is one which does not utilize 
a man endowed with a consciousness where there was no consciousness 
before, but rather an individual who takes over the whole social process into 
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his own conduct That ability, of course, is dependent first of all on the 
symbol being one to which he can respond, and so far as we know, the 
vocal gesture has been the condition for the development of that type of 
symbol Whether it can develop without the vocal gesture I cannot tell 24 

I want to be sure that we see the content put into the mind is only a de- 
■velopment and product of social mteraction It is a development which is 
of enormous importance, and which leads to complexities and complica- 
tions of society which go almost beyond our power to trace, but onginallv 
It IS nothing but the taking over of the attitude of the other To the extent 
that the animal can take the attitude of the other and utilize that attitude 
for the control of his own conduct, we have what is termed mind, and 
that IS the only apparatus involved m the appearance of mind (pp 1 90-191) 

Mead is here obviously painting on a large canvas with bioad strokes 
and includes territory which lies beyond the scope of our present 
inquiry, but his analysis points in the direction in which behavioi 
theory must ultimately move and, for immediate purposes, serves to 
highlight the distinction, previously suggested, between the use of 
signs as signals and as symbols An ammal may, advertently or inad- 
vertently, make a sign to which other animals react meaningfully, 1 e , 
with a conditioned (usually emotional) response, but the first animal 
will not, argues Mead, necessarily react similarly On the other hand, 
human beings, as a result of their membership m a more complex so- 
cial group, react to then own signs very much as they expect others to, 
and theiein, says Mead, is the essence of the symbolic (as opposed to 
the mere signaling) function 

Mead’s lectures and writings have had a stimulating and inspiring 
effect throughout the social sciences and are probably more influential 
now than they were during Mead’s own lifetime But his analysis of 
the symbol, shrewd as it is in many ways, still seems incomplete, and 
we turn to a modest but unusually penetrating treatment of this sub- 
ject by the French philosopher and scholar, Ernst Cassirer, in his book 
A71 Essay on Man (1944) Here, in a chapter entitled “From Animal 
Reactions to Human Responses,” we find a line of reasoning which co- 
incides well with the one followed in this volume and which, when 
combined therewith, enables us to take at least one additional forwaid 
step toward the resolution of the nddle of symbolic function 

^Elsewhere in the same volume Mead has significandy observed “It is this 
which gives such peculiar importance to the vocal gesture it is one of those 
social stimuli which affect the form that makes it in the same fashion that it 
affects the form when made by another That is, we can hear ourselves talking, 
and the import of what we say is the same to ourselves that it is to others” (p 
62) For a similar emphasis, see Chapter 3, Cassirer (1944, see especially Chapter 3) 
treats this matter somewhat differently See also Chapter 10, Section II 
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Many of the writers previously cited in this chapter have graphically 
reconstructed the emergence of language and what it has meant for 
human beings in general, and we have also commented on the excite- 
ment which a small child shows when he or she gets the “hang” of 
language and thiough it finds himself entering into a far more ex- 
tensive and wonderful “world” than he ever before supposed to exist 
But no one has done better in capturing this marvel of language in 
w ords than Cassirer when he says 

In the mental development of the individual mind the transition from 
the one form to the other — ^from a merely practical attitude to a symbolic 
attitude — ^is evident But here this step is the final result of a slow and con- 
tinuous process By the usual methods of psychological observation it is 
not easy to distinguish the individual stages of this complicated process 
There is, however, another way to obtain full insight into the general char- 
acter and paramount importance of this transition Nature itself has here, 
so to speak, made an experiment capable of throwing unexpected light 
upon the point in question We have the classical cases of Laura Bridgman 
and Helen Keller, two blind deaf-mute children, who by means of special 
methods learned to speak 

In order to arrive at such an understandmg the child had to make a new 
and much more significant discovery It had to understand that everything 
has a name — that the symbolic function is not restricted to particular cases 
but is a prmciple of universal applicability which encompasses the whole 
field of human thought In the case of Helen Keller this discovery came 
as a sudden shock She was a girl seven years of age who, with the ex- 
ception of defects in the use of certain sense organs, was in an excellent 
state of health and possessed of a highly developed mind By the neglect 
of her education she had been very much retarded Then, suddenly, the 
crucial development takes place It works like an intellectual revolution 
The child begms to see the world in a new light It has learned the use 
of words not merely as mechanical signs or signals but as an entirely new 
instrument of thought A new horizon is opened up, and henceforth the 
child will roam at will in this incomparably wider and freer area 

The principle of symbolism, with its universality, validity, and general 
applicability, is the magic word, the Open Sesame^ giving access to the 
specifically human world, to the world of human culture Once man is m 
possession of this magic key further progress is assured (pp 34-35) 

Granted, then, that it is the “symbolic attitude” and the capacity for 
naming which mark the transition fiom mfiahuman mentality, we 
are still not entirely clear as to how this comes about and of precisely 
what It consists Cassirer attacks this pioblem as follows 

It is necessary, first of all, to find a correct logical starting point, one 
which can lead us to a natural and sound mterpretation of the empirical 
facts This starting point is the definition of speech (Revesz, 1940, 1941) 
But instead of giving a ready-made definition of speech, it would be better 
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perhaps to proceed along tentative lines Speech is not a simple and uniform 
phenomenon It consists of different elements which, both biologically and 
systematically, are not on the same level We must try to find the order 
and interrelationships of the constituent elements, we must, as it were, dis- 
tinguish the various geological strata of speech The first and most funda- 
mental stratum is e\identlv the language of the emotions A great portion 
of all human utterances still belongs to this stratum But there is a form of 
speech that shows us quite a different type Here the word is by no means 
a mere interjection, it is not an involuntary expression of feeling, but a 
part of a sentence which has a definite syntactical and logical structure 
(Sapir, 1921) It IS true that even in highly developed, in theoretical language 
the connection with the first element is not entirely broken off Scarcely 
a sentence can be found— except perhaps the pure formal sentences of 
mathematics — ^without a certain affective or emotional tinge (Bally, 1936) 
Analogies and parallels to emotional language may be found in abundance 
in the animal world As regards chimpanzees Wolfgang Koehler states that 
they achieve a considerable degree of expression by means of gesture Rage, 
terror, despair, grief, pleasing, desire, playfulness, and pleasure are readily 
expressed in this manner Nevertheless one element, which is characteristic 
of and indispensable to all human language, is missing we find no signs 
which have an objective reference or meaning “It may be taken as positively 
proved,” says Koehler, “that their gamut of phonetics is entirely ‘subjective,’ 
and can only express emotions, never designate or describe objects But 
they have so many phonetic elements which are also common to human 
languages, that their lack of articulate speech cannot be ascribed to sec- 
ondary (glosso-labial) limitations Their gestures too, of face and body 
like their expression in sound, never designate or ‘describe’ objects (Buhler)” 
(Koehler, 1921, p 27, also see Koehler, 1927, p 317) 

Here we touch upon the crucial point m our whole problem The dif- 
ference between propositional laiiguage and emotional language is the real 
landmark between the human and the animal world All the theories and 
observations concerning animal language are wide of the mark if they fail 
to recognize this fundamental difference ^3 In all the literature on the sub- 
ject there does not seem to be a single conclusive proof of the fact that any 
animal ever made the decisive step from subjective to objective, from 
affective to propositional language Koehler insists emphatically that speech 
IS definitely beyond the powers of anthropoid apes He maintains that the 
lack of this invaluable technical aid and the great limitation of those very 
important components of thought, the so-called images, constitute the causes 
which prevent animals from ever approaching even the least begmnmgs of 

An early attempt [says Cassirer] to make a sharp distinction between proposi- 
tional and emotional language was made in the field of the psychopathology of 
language The English neurologist Jackson introduced the term propositional 
language in order to account for some very interesting pathological phenomena 
He found that many patients suffering from aphasia had by no means lost the 
use of speech but that they could not employ their words in an objective, proposi- 
tional sense Jackson’s distinction proved to be very fruitful (For details see 
Cassirer, 1923, III, pp 237-323) 
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cultural development If we proceed from a clear and precise defini- 
tion of speech, all the other forms of utterances, which we also find in 
animals, are automatically eliminated (pp 29-30) 

X Symbolism— and Language— a Matter of "Abstraction^^ 

Here, apparently, is an analysis which permits us to bring all our 
other observations into orderly relationship Stewart (1946) was right 
in insisting that the discovery of nouns marked the advent of real 
language, for they and they alone make sentences (propositions) pos- 
sible The sentence, we find, can be understood psychologically only 
if the concept of mediation is employed And as the next chapter will 
show, imagery as well as emotion is an important aspect of meaning 
But there is still a mystery As we have repeatedly seen, mediation is 
by no means absent in infrahuman orgamsms and cannot, therefore, 
account for the fact that full-fledged language is found only in human 
beings We now have reason for supposing that animals experience a 
wide lange of emotions, and there is no compelling reason for sup- 
posing that they do not also have at least some imagery (Chapter 5) 
So perhaps the issue comes down to the matter of “nouns”, but then 
we recall the hypothetical experiment described in section VII of this 
chapter, wherein a blinking light is made to “stand for” cheese and to 
function, in all essentials, as a noun It is true that this experiment has 
not been fully carried out, but there are no a prion grounds for 
thinking it would not work And if it did work, would we not have 
eliminated the last remaimng logical reason why animals cannot 
“talk”^’ Not quite, for we must remember that such a “sentence” 
would be expected to function only if the subject were hungry and 
actively wanted cheese Then and only then, so far as we can gather, 
would the blinking light mean anything to a rat, rouse his “interest,” 
and elicit a response that could mediate the “message” provided by the 
buzzer “predicate ” When animals have no immediate, “practical” need 
for an object, they likewise have no interest in a sigii thereof — and 
thus fall short of exhibiting symbolic behavior They are, in other 

Brown (1958b, viu) quotes “a distinguished learning theorist” as saying that, 
for him, the remarkable thing is not that human beings can talk but that animals 
cannot (see also Brown, p 156S) Small children take it for granted that animals 
can talk and often show far less astonishment than do adults upon hearing a 
“talking bird” The child’s expectation is by no means an unnatural or nai\e one 
^ A possible misapprehension should be anticipated at this point As demonstrated 
elsewhere (Mowrer, i960. Chapter 5), animals do not have to be hungry, le, 
motivated by a primary drive, in order to be interested in food, if they merely 
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words, like the aphasic human subjects of Jackson (see footnote 25) 
who have lost their “propositional sense,” 1 e , the ability to use (and 
perhaps even understand) words in then abstract, referential, purely 
“informational” sense What the aphasic human being has lost, neuio- 
logically, infrahuman oiganisms apparently have never possessed They 
lack, in other words, not only the “symbolic attitude” but also the 
very capacity for such an attitude, and since even the most intensive 
efforts (e g , those of Dr and Mrs Hayes) to provide the requisite 
social conditions and encouragements for the development of this ca- 
pacity have been unavailing, we may legitimately conclude that the 
defect is neuiological 

Skinner (1957) insists that the difSculty is, quite simply, that no 
creature other than man has gained voluntary control of his vocal 
cords and foi this reason has never developed language This hy- 
pothesis has two serious weaknesses (i) In the passage quoted from 
Cassirer, reference is made to Koehler’s pertinent observation that if 
lack of voluntary control of the vocal apparatus were the only bairier 
to language in chimpanzees (or other animals), they would resort (as 
human beings do when there is vocal incapacity) to gestures made by 

have hunger fear, they may still seek and “hoard” it Therefore, in saying that 
an animal is not “interested” in an object unless he has a “practical” need for it, 
we are not excluding the possibility that this need may be derived (secondary), 
rather than primary, as these terms are now used in psychological parlance In 
saying that an animal has no practical interest in food, we mean that the animal, 
at the moment, has neither hunger nor fear of hunger 

^Co\erage of the relevant literature may seem to ha\e been in some ways 
eccentric in this chapter For example, only passing attention has been given to 
the just-cited major work of Skinner This is because (i) Skinner is not interested 
in mediation and predication, which are our central concerns, and (2) his whole 
approach is so primiavely Behavioristic that mere is little conceptual contact be- 
tween It and our own, although many of the experiments performed by Skinner 
and his followers are extraordinarily useful (For reviews of Slanner’s book on 
language, see Osgood, 1958, Morris, 1958, and Chomsky, 1959 ) Osgood and his 
students have done yeoman service in developing objective methods for studying 
the phenomenon of meaning (cf Chapter 5), and there is obviously much in 
common between his approach and the present one Osgood has not, however, 
as yet written a systematic, general treatment of language, so it remains to be 
seen just what his ultimate position here will be (For reviews of The Measure- 
ment of Meaning, by Osgood, Suci, & Tannenbaum, 1957, see Brown, 1958a, Gulhk- 
sen, 1958, and Wemreich, 1958 ) Carroll (1953), Johnson (1946, 1956), G A Miller 
(1951), Piaget (1952), Whorf (1956), and Zipf (1949) have also written per- 
ceptively in this field but from specialized standpoints, such as Information Theory 
or General Semantics, which limit the relevance of their works for the present 
discussion For a review of recent books by Johnson and Whorf, see Mowrer ( 1957) 
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parts of the body which are unmistakably under voluntary control, and 
(2), this explanation would not, in any event, apply to many species 
of birds, in which vocalization is quite as versatile and voluntary as is 
any other form of behavior The far more basic and general explanation 
of the failure of animals to develop language hes, it seems, in the fact 
that when a sign is of no immediate (“practical”) interest to them, 
they simply cannot be induced either to attend to it or to make it 
For this reason they have no “nouns” (in the sense of signs with a 
purely abstract, referential function) , and having no nouns, they have 
no sentences, and lacking sentences, they do not have language 
The term, abstract^ is interesting in this connection It comes from 
two Latin words meaning separated, apart from, or, more literally, to 
draw away In the above analysis, it is suggested that ammals cannot 
“abstract” in the sense of making or reacting to a sign when they have 
no interest in the sigmficate In other words, they cannot separate or 
detach the sign and employ it for reasons which are motivationally un- 
related to the object or event which the sign represents Thus, we may 
say, a symbol is an abstracted sign And here, perhaps, lies one of the 
reasons why its precise identification and definition has been so diffi- 
cult a symbol is not distinguishable from an ordinary sign in terms of 
Its jorm, It IS only when the motivation behind its usage is taken into 
account that the difference clearly emerges When a thirsty child 
cries, “Water, water’” he is using a sign, in much the same way that 
lower animals do, but, when not thirsty himself but instead questioned 
by a playmate, he says, “Water is in the pitcher,” he is using a symbol 
Here the child’s motivation is quite unrelated to personal thirst This is 
not to say that in using words symbolically human beings are un- 
motivated, they are rather behaving m response to motives which are 
separated, abstracted from the referents themselves Therefore, the 
absence of symbolism in animals may be due, in part at least, to de- 
liminations in their motivational systems, perhaps along lines suggested 
in the passage quoted from G H Mead 
Elsewhere (Mowrer, 1954) much the same notion has been phrased 
as follows Before man could develop language he not only had to get 
the “noun-idea” (Stewart, 1946), he also 

had to have achieved enough social organization to make “helping others,” 
through speech, a rewarding activity The notion that language is used to 
“help others” calls attention to two quite different conceptions of its func- 
tion One common view of language is that it is used primarily as a means of 
helping oneself, this view is discussed [m Section I] Here language is seen 
as serving mainly to coerce or caj ole someone else into doing something use- 
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ful for the speaker (or writer) By contrast, there is the view that language 
IS the medium by which “gifts” are bestowed upon others, we are said to 
“give them information,” which they will find useful In fact, perhaps the 
best definition of “education” is that it is a means whereby one person (usu- 
ally through language) helps another solve some problem more quickly than 
he himself could do on an unaided (trial-and-error) basis Ontogeneticallv, 
the “selfish” use of language comes first and the “altruistic” use later [cf 
Chapter 3, and especially the autism theory of word learning], and perhaps 
this was also true historically But in any event we can say that both uses of 
language presuppose considerable social co-operation (p 675) 

This IS not to say, of course, that the altruistic, “unselfish” use of 
speech is not motivated and reinforced, but simply that speech, at this 
level, is disconnected (abstracted) from the motivations to which it 
most directlv pertains and occurs because of more remote, more “re- 
fined” drives and interests A high degree of social co-operativeness, 
or helpfulness, is achieved in the “language” of bees, as already noted, 
but this may reflect more of an instinctive arrangement than conscious 
motivation and satisfaction In any case, the bees lack true nouns and 
are thereby barred from a truly abstract (freely propositional) lan- 
guage 

In other words, it appears that tnjoo conditions, both of which are 
presumably found only in human beings, must obtain before bona fide 
language is possible ( i ) certain neurological developments which make 
It possible for an individual to utter a word pertaining to one motive 
or interest system under the impact or pressure of a different motive 
or desire, and (2) a degree of social development which will provide 
and activate the latter type of motivation A subtle interplay of neuro- 
logical and social evolution thus seems to have provided the (extremely 
unlikely) conditions for the development of the “symbolic attitude” 
and fully articulate (“free”) speech Language is thus truly a miracle, 
not only in terms of what it can do, but also in terms of the improba- 
bility of its emergence 

In this analysis, we are not, of course, saying anything which has 
not been said before in more general terms, and we still leave un- 
answered the question of precisely what it is, neurologically, that 
makes fully symbolic activity possible But perhaps we have here 
focused the problem a little more sharply, in a way that will generate 
new researches and will help us to penetrate further into this fascinating 
field of inquiry 




Imagery, Memory, and Attention 
{Observing Reactions) 


For psychologists whose graduate training dates back to the 1920’s 
or 1930’s, the terms which constitute the title of this chapter were then 
and perhaps are still, in some measure, taboo Many of us were taught, 
under pain of banishment from professional psychology, never to use 
these terms, at least not during “working hours ” In our discourse with 
laymen it was permissible, indeed essential, to use them (or their 
equivalents), but such language was deemed completely unsuited to 
the purposes of science 

The situation is, of course, changing, as the preceding chapters of 
this book attest But it is slightly iromcal that those very methods of 
analysis and research which radical Behaviorism introduced are now 
leading us, ineluctably, back to concepts which Behaviorism was de- 
termined to ignore — or even destroy 
In the two preceding chapters we have seen that our earlier analysis 
of the psychology of learning (Mowrer, i960) has laid a useful founda- 
tion for an improved understanding of language With the concepts 
and principles now available, we have a better grasp than formerly 
of how children learn to utter words and perhaps also of how, in the 
history of mankind, words originated and evolved And we have, 
within the same theoretical framework, a new and seemingly quite 
powerful basis for explaimng the operation of those word constella- 
tions which we call sentences However, in one important respect our 
discussion of language has been inadequate — or, more precisely, oui 
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discussion has revealed an inadequacy and incompleteness in the psy- 
chological underpinmng of language This crucial defect has to do with 
the phenomenon of meanings which will be the first topic of special 
concern in this chapter This will lead naturally to consideration of 
the other concepts comprising the title of this chapter 

\ The Problem of Meaning, Imagery, and Reinforcement 

In a graduate seminar, a bright — and slightly impish — female stu- 
dent once asked this disconcerting question She wanted to know, 
she said, just what ts this ‘‘mediating reaction” which we had been 
stressing as so essential in explaimng the operation of sentences As in 
the preceding chapter, we had been speaking, light-heartedly, of meaji- 
i 7 igSj but the only definition we had given of them was an operational 
one When a word is associated with a thing (in the nominative or 
naming relationship), it acquires the capacity, alone, to arouse some 
part of the total reaction produced by the thing itself This condition- 
able component of the total reaction to the thing is, by assumption, the 
word’s meaning 

But elsewhere (Mowrer, i960) we have rejected the notion of the 
conditionabihty of overt, behavioral responses and have concentrated 
instead upon the emotions — and, more particularly, upon hope and 
fear Therefore, what the student was asking, really, was whether these 
two emotions could be reasonably supposed to perform all the func- 
tions we were attributing to the so-called mediators The answer, 
manifestly, is that they cannot And we have already suggested 
(Chapter 4) the direction in which one may look for a more com- 
plete type of explanation As Osgood & Suci (1955) and Spitz (1958) 
have shown, a considerable portion of the meamng of many words is 
indeed evaluative (good-bad, emotional), but this leaves a sizable 
remnant of the meamng “variance” (as measured by the “semantic 
differential”) unaccounted for (see also Noble, 1958) Here, pre- 
sumably, lies the specifically denotative or “cognitive” aspect of mean- 
ing Thus, the word “apple” not only carries the implication of some- 
thing liked or disliked but also of an object with certain purely 
sensory qualities And, thus far, our account of learmng contains no 
provision for explaimng this, as opposed to the purely emotional, 
evaluative aspect of the meamng reaction 

There is, one quickly discovers, excellent piecedent for distinguish- 
ing between the evaluative and the cognitive aspects of meaning 
Cassirer (1944), m a passage already quoted in Chapter 4, says 
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The first and most fundamental stratum [of speech] is evidently the 
language of the emotions A great portion of all human utterance still be- 
longs to this stratum But there is a form of speech that shows us quite a 
different type Here the word is by no means a mere interjection, it is 
not an involuntary expression of feeling, but a part of a sentence which has 
a definite syntactical and logical structure (p 29) 

Bertiand Russell, in Hinncin Knowledge In Scope and Lnnin ( 1948), 
draws the distinction thus 

Music may be considered as a form of language m which emotion is 
divorced from mformation, while the telephone book gives information 
without emotion But in ordinary speech both elements are usually present 

(p 59) 

Or, consider a formulation by Carroll (1953) 

In our discussion of the implications of a theory of language and meaning 
for education m the advanced language skills, we have already alluded to 
another direction in which Ogden and Richards’s work has had an influence 
This IS the use of semantics in interpretation, which in this context may 
be defined as the analysis of the total content and effect of any verbal com- 
munication into elements relating to its “plain sense,” its “feeling,” its “tone,” 
and Its “intention ” In this way, both the symbolic and the emotive contents 
with which a message is charged are to be taken account of (p 163) 

And the contrast is made particularly clear in a recent book by 
Bouldmg (1956) 

The subjective knowledge structure or image of any mdividual or organiza- 
tion consists not only of images of “fact” but also images of “value ” 

If I say “Stanford University is m California,” this is rather different from 
the statement “Stanford University is a good university, or is a better uni- 
versity than X, or a worse university than Y ” The latter statements con- 
cern my image of values, and although I shall argue that the process by 
which we obtain an image of values is not very different from the process 
whereby we obtain an image of fact, there is clearly a certain difference 
between them (p ii) 

The emotions of fear and hope aie obviously examples of what 
Bouldmg IS referring to as “images of values,” 1 e , fear is an “image” 
or anticipation of something bad, punishing, wheieas hope is an 
“image” of a good, rewarding experience But what is a factual 
“image”^ The answer, it seems, is precisely that phenomenon which 
has been historically known, quite simply, as an image Behaviorism 
bamshed not only the concept of imagery but also that of emotion 
The latter, by the route already traced in this book (and the preceding 
one), has been re-admitted into psychological science, and it appears 
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that a similar fate may now be in store for the former as well So the 
issue IS How can the phenomenon of imagery be conceptualized, if 
at all, within the general framework of two-factor learning theory^ 

Many years ago, the following incident occurred in connection with 
an experiment which the writer was conducting for quite a different 
purpose (Mowrer, 1938a) Human subjects were being given an electric 
shock (through wrist electrodes) which started at zero and gradually 
increased in intensity Subjects were instructed to press a key as soon 
as the shock became perceptible, at which point the shock reset to 
zero and the cycle started again On this particular occasion, the pro- 
gramming apparatus broke down while a subject was being run, but 
since he was located in an adjacent sound-proofed room, he did not 
know of this The experimenter, while re-adjusting the stalled ap- 
paratus, was surprised to find that the subject was still periodically 
pressing the key, although obviously (to the experimenter) receiving 
no shock What, clearly, had happened was that the subject had de- 
veloped a temporally conditioned sensation of shocks or a sort of 
periodic ‘‘hallucination ” A survey of psychological literature (see, 
for example. Perky, 1910) showed that similar findings had been re- 
ported previously, usually under the rubric of “suggestion”, and not 
long thereafter Ellson (1941a, 1941b) reported the deliberate repro- 
duction of this type of phenomenon 

Particularly relevant is a paper by Leuba, “Images as Conditioned 
Sensations,” which appeared in the Journal of Experimental Psychology 
in 1940, and which concludes with these two sentences 

Our experiments mdicate that after an inadequate stimulus has been pre- 
sented a number of times, while an mdividual is experiencing certain sensa- 
tions, It will by itself automatically, and without the intervention of any 
conscious processes, produce those sensations An image can, therefore, be 
considered as a conditioned sensation (p 351) 

Although cast in the vernacular of the modern conditioning labora- 
tory, the notion that an image is a conditioned sensation (see also 
Cason, 1936) squares not only with common sense but also, as we shall 
presently see, with certain classical psychological notions An image, 
in common parlance, is some object which an individual “sees” or 
otherwise “perceives” without the object being objectively present 
By a word, another image, or some other stimulus, the individual is 
reminded of the object and reacts somewhat as if it were actually 
present In other words, a part of the total experience produced by 
the object itself is here being aroused as a learned, conditioned response. 
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and this response we call an image — and the process of its arousal, 
imaginati 07 i ^ 

As will be discovered in Boring’s History of Experimental Psy- 
chology (1929), all this seems to have been well understood by the 
early English psychologist, David Hartley (1705-1757), as indicated 
by this sentence which Boring quotes 

Sensations, by being often repeated, leave certain Vestiges, Types, or 
Images, of themselves, which may be called, Simple Ideas of Sensations (p 

199) 

Thus, without further ado, we shall postulate that images are indeed 
conditioned sensations and that, as such, they are an important part — 
the cognitive or representati 07 ial part — of the meanings which words 
(and quite possibly certain other stimuli) characteristically come to 
possess But if in this way we gam in realistic understanding of the 
genesis and nature of meaning, we also introduce a considerable com- 
plication for learning theory 

Since about 1930, a distinction has grown up between so-called 
reinforcement theory and contiguity theory in the field of learmng 
Although the term “reinforcement” was originally used by Pavlov to 
denote the learning that occuis when a conditioned stimulus im- 
mediately precedes an unconditioned stimulus, the term became grad- 
ually identified, at least m this country, with the special views and 
formulation of Clark L Hull For him, all learning was contingent 
upon drive reduction, or what he called “primitive reinforcement,” of 
some kind, and sheer stimulus contiguity was not alone deemed a suf- 
ficient condition for learning In two-factor theory, something of a 
reconciliation has already been achieved in this connection Learning, 
in the sense of emotional conditioning, is here assumed to occur under 
two different conditions of “reinforcement,” drive decrement and 
drive increment, so that stimulus contiguity and reinforcement (of 
one form or the other) are both seen as essential But now, with the 

^What IS being assumed here is analogous to the fact that an electric shock 
produces pain and fear but that only the fear, generally speaking, is conditionable 
Thus It is legitimate, it would seem, to speak of an image as the conditionable 
fraction of a sensation One would not want a sensation, in its totality, to be 
conditionable, for this would lead to a full-scale hallucination When, therefore, 
things work out right, we experience just enough of the original sensation to know 
what It IS but not enough to make us think that we are actually having it again 
In other words, we know it is “all in your head” mstead of “out there ” See Section 
XII, also Chapter 7, Section II 
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admission of the concept of an image as a conditioned sensation, we 
seem to be dealing \\ith a form of learning which presupposes only 
stimulus contiguity, “pure contiguity” as it is sometimes called, with- 
out the occurrence of either drive increment or decrement 

Because a so-called unconditioned stimulus often has either reward- 
ing or punishing properties (at least in mild degree), it is not always a 
simple matter to demonstrate “pure contiguity” learmng, but experi- 
ments on “sensory preconditioning” are sometimes cited in this con- 
nection (cf Mowrer, i960, pp 281-282) For example, Bitterman, 
Reed, & Kubala (1953) begin an aiticle on this subject as follows 

As Birch and Bitterman (1949) noted in a recent analysis of the nature 
of reinforcement, the phenomenon of sensory preconditionmg poses a 
rather difficult problem of Hullian theory Consider, for example, an 
experiment by Brogden (1939) Two stimuli, a tone and a light, are 
repeatedly paired in the first stage of training [with dogs as subjects], and 
in the second stage one of these stimuli, say the light, is paired with 
shock to the forelimb until it comes to elicit a flexion response Fmally, 
the tone is presented alone and the flexion response appears despite the 
fact that tone and flexion have never before occurred in temporal contiguity 
(P 178) 

From this type of observation it has sometimes been reasoned that 
the mere concurrence of two presumably neutral stimuli such as the 
bell and light produces associative learning, no less than does the pair- 
ing of one such stimulus and a more “meaningful” stimulus such as 
electric shock or food Because, in the example cited, the tone proves 
capable of eliciting the flexion response, it is held that, in “sensory 
preconditioning,” the tone came to “stand for” the light, so that as 
soon as the light, as a result of regular conditioning, came to stand for 
the shock, then tone also was premomtory of shock and so produced 
the flexion-reaction Some investigators have dismissed such findings 
as artifacts, attributing them to sensitization or “pseudo-conditiomng ” 
Here it will not be necessary for us to enter into the merits of the 
argument, on either side (foi a sophisticated new study, see W J 
Coppock, 1958), foi there is an overriding consideration of a purely 
theoretical nature The difficulty with the notion of pure contiguity, 
or S — S conditioning as it has sometimes been called, is that it “ex- 
plains” all too much We know, quite w^ell, that mere conjunction of 
stimulation is by no means a guarantee of learmng Consider, for 
example, the case of Mr Jones, who has, for years, paid bills, by mail, 
to certain places of business without, however, ever learning their 
addresses Here, if learmng were a matter of pure contiguity, he 
should learn the “connection” between each business concern and the 
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address to which he monthly remits But he does not learn, and if one 
asks Mr Jones why he does not, he will say “It’s because I’m not 
interested I don’t Jieed to remember the addresses — ^they’re always 
on the bills If I had a reason, a motive for learning, then, of course, I 
could and would ” 

Compare, for example, the man who drives an automobile to work 
each morning and has to park, as opportumty affords, in different 
places Occasionally he may misremember where his car is at the end 
of the day, but, m general, he will do surprisingly well in keeping its 
location “in mind,” a performance which, superficially, may look like 
perfect learning, in 072 e trial But the image, or memory, of where 
the cai IS located can be, and probably is, recalled or “rehearsed” from 
time to time during the course of the day Here, clearly, the car owner 
(unlike Mr Jones) has a lively incentive for remembering, and does 
so But the basis on which this feat occurs is obviously not “sheer con- 
tiguity” — motivation also importantly enters into the picture 

Thus, in this commonplace example and many other instances that 
might be cited, mere conjunction of sumulation does not provide the 
sufiicient conditions for learning, and one is left, in terms of a “sensory- 
sensory contiguity theory,” with no guiding principle for deciding 
when contiguity will and when it will not result in learning In ordinary 
conditiomng, where the second stimulus is definitely rewarding or 
punishing, contiguity is a necessary condition for learmng, but the 
indications are that it is not sufficient If it were, then living organisms 
would foim countless associations which would be perfectly useless 
and meaningless Interest, meaning, motivation, significance, “reinforce- 
ment” must, apparently, be in some way involved, though this “dy- 
namic” factor can apparently operate in very subtle and unaccountable 
ways 

More specifically, this argument means that we have no way as yet 
for determining when a sensation will or will not be “conditioned” 
and thus elicitable as an image, but the indications are that here, as 
elsewhere, mere contiguity is no guarantee of learmng and that some 
element of reinforcement is a crucial, though as yet often obscuie, 
determinant - 

^In his doctoral research at the University of Buffalo, Mr Steven Finesmith 
(1959) has recently obtained laboratory support for the foregoing conjectures 
His subjects were required to learn a series of nonsense syllables, presented as 
paired associates, at the same time that psychogalvamc readings were being taken 
In the early stages of learning, presentation of the first of a pair of syllables 
would produce a slight PGR, which reached a peak on the trial on which the 
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In 1956 the present writer published, in one of the technical journals, 
a preliminary version of the argument which is summarized in Chapter 
I of this book but, in advance, invited Dr K S Lashley to comment 
thereon The latter’s reply reads, in part, as follows 

I agree with your basic idea but think it a mistake to call it a theory of 
learning, it is a theory of motivation of action but seems to me irrelevant 
to the formation and retention of associations I was recently served a very 
bad meal at a restaurant I shall not go there again but I remember in 
detail the arrangement of the dining room, the appearance of the waitress, 
the flavor of the bad coffee, even the decorations on the dinner ware 

Motivational theories were developed from studies of animals, m which 
It is very difficult to demonstrate memory without motivating action But 
even with rats one can observe bits of behavior which suggests that in the 
course of training the animal learns many things unrelated to the motivation 
of the experiment Like me, the animal learns his motives but learns a great 
deal besides I feel sure that the learnmg problem would be much clarified, 
if this distinction were emphasized The key to learning is in the phenomena 
which Thorndike called ‘‘Belongingness,” but I don’t seem able to make any 
progress here ^ 

Here Dr Lashley put his finger on a major weakness toward the 
ehmmation of which efforts are being made in this chapter In the 
preceding section we have posited a mechanism whereby sensations 
may become converted into images, and once the reality of images is 
established, so also is the phenomenon of memory Once we have 
recognized the possibility that sensations can be conditioned to words 
or other psychological events that can serve to “recall” them, then the 
basis IS laid both for memory, as it applies to things past, and for 
imagination, as it applies to things to come (And “forgetting” might 
be accounted for in terms of reconditioning or counterconditiomngs, 
along lines suggested in Chapter ii of Learning Theory and Behavior ) 
Here, presumably, we have a basis for the phenomenon which Lashley 
(with others) has referred to as the “formation of associations,” but 

associated syllable was first recalled and then, on ensuing trials, declined Al- 
though the “content” of nonsense syllables is inherently about as unemotional 
as anything can be, yet emotion seems to accompany the actual learning process 
Precisely how it operates is sail a mystery, but Finesmith’s results substantiate the 
view that even the most “cognitive” types of learning probably involve motiva- 
tion and reinforcement 

®Lewin, in 1942, made a very similar plea for the recogniaon of two kinds 
of learning the learnmg of motivaaons and the learning of cogmaons 
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the underlying mechanism proposed is the familiar one of conditioning, 
not the gestalt-like concept of Belongingness advanced, but never very 
effectively developed, by Thorndike As indicated earlier (Mowrer, 
i960, Chapter 8), Tolman has, of course, long stressed the reality and 
importance of “pure cognition” in animal learning, which Guthrie has 
cogently criticized on the grounds that while it may lead to all man- 
ner of wisdom in a rat, it never gets him anywhere Having posited 
cognition, we must also get motivation into the picture Our pro- 
cedure in the present work has followed this course we have started 
with the motivational aspect of learning and have found that it will 
carry us far but that eventually the cognitive or mnemonic aspect must 
also be considered The concept of the image as a conditioned sensa- 
tion seems to provide a solid linkage between these tAvo domains E B 
Holt (1931) once remarked that the phenomenon of conditioning 
“brought mind into existence ” If, as now seems likely, conditioning 
can be made to account for both motivation and cognition, it goes a 
long way in this connection Although Pavlov’s (and Watson’s) at- 
tempt to make the conditioned reflex the umt from which all behavior 
is constructed was a failure, the concept of conditioning nevertheless 
provides us with the basis for understanding both motivation and 
cognition and thus arriving at a more adequate and more sophisticated 
picture of behavior than Behaviorism itself was able to provide ^ 

It IS not without significance that the economist, Kenneth Boulding, 
after spending a sabbatical year recently at the Ford Center for Ad- 

^The noaon that an image is a conditioned sensation suggests a somewhat 
altered way of thinking about the conditiomng process in general It is conven- 
tional to assume that the response in question is initially produced by a so-called 
unconditioned stimulus, UnCS, and that, by virtue of its temporal conjunction 
with the UnCS, the conditioned stimulus or CS m some way acquires the 
capacity to produce the response, R, directly It is, however, entirely conceivable 
that conditiomng operates in a different way namely, that the CS acquires the 
capacity to produce R, not directly, but by virtue of first producing an image 
of the UnCS to which R is already “connected” (just as it is to the UnCS itself) 
Thus, the apparent conditioning of R to CS would be achieved, not directly, but 
through the mediating action of the conditioned image of the UnCS Instead of 
emotional and imagmal conditioning being parallel phenomena, the former, ac- 
cording to this view, would be derivable from the latter, and all conditioning 
(learning), in the final analysis would be “cognitive” The writer is indebted to 
Mr In-Mao Liu for the suggestion that this conception of learning may be close 
to that implied by Hebb (1949) This idea (see also Eriksen, 1958, p 206 ff ) gen- 
erates some very defimte expectations concernmg the neuro-physiology of condi- 
tioning, It will be explored more fully in Chapter 7, especially Section IX (cf 
Mowrer, i960, p 260, Schonback, 1958) 
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vanced Study in the Behavioral Sciences, at Stanford University, de- 
cided to summarize his year’s work there in the small book (already 
cited) called The linage, the historical background of which he gives 
as follows 

Psychology started out with an image of the mind as a sort of jigsaw 
puzzle of ideas The science took a firmly antieiconical turn, however, 
with the development of behaviorism It is a little difficult to believe that 
Dr Watson actually believed what he is supposed to have believed, namely, 
that Dr Watson w^as an epiphenomenon It is, however, in the record that 
this IS what psychologists used to believe The attempt to interpret the 
organism as a stimulus-response slot machine was terribly good for the rat 
business, but it certamly was not eicomcs With the coming of the Gestalt 
school, how^ever, psy^chology began to take a sharply eicomcal direction 
Psychologists began to conceive the organism not merely as a jigsaw puzzle 
or as a slot machine but as an organization (p 15 1) 

As a result of his year of special study Dr Boulding thus concluded 
that the “behaviorial sciences” have moved on beyond Behaviorism 
and are ready to take a broader view of psychology and life It is not 
possible or necessary here to review his argument in detail, but the 
following excerpt gives some of the high lights of Bouldmg’s thinking 

What I have been talking about is knowledge Knowledge, perhaps, is 
not a good word for this Perhaps one would rather say my Image of the 
world Knowledge has an implication of validity, of truth What I am 
talking about is what I believe to be true, my subjective knowledge It is 
this Image that largely governs my behavior The first proposition of 
this work, therefore, is that behavior depends on the image (pp 5-6) 

Here, certainly, is a point of view which is radically different from 
Behavionsm but one which squares well with the approach followed 
in this book (see also McClelland, 1955) Although, prior to this 
chapter, we have not specifically used the term, image, it has been 
in several ways implied For example, in Chapter 8 of Learning Theory 
and Behavior, in discussing the procedure of teaching a dog to “shake 
hands,” it might have been said that what we thus do, when we move 
the dog’s leg passively (and then provide a reward), is to give the dog 
an image of the particular response we wish him to make and which 
he also, as a result of our traimng, later wishes to make In Chapter 12, 
under the rubric of skill, we spoke of the accomplished musician or 
athlete having a clear picture, or “image,” of what he (and others) 
regard as a good performance And in Chapter 3 of the present volume 
the same logic was applied to the process whereby human infants 
learn to utter conventional word noises, and other organisms come to 
“imitate” in other ways Hence, the notion that “behavior depends on 
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the image” is by no means foreign to us, and our detailed analysis of 
the learning process provides a rather more explicit explanation of the 
genesis of images than does Bouldmg’s discussion “The image,” he says, 
“is built up as a result of all past experience of the possessor of the 
image” (p 6), and he specifically attributes its origin to the “stream 
of messages entering the organism from the senses” (p 6), but his 
analysis in this connection is otherwise somewhat indefinite The ex- 
perimental facts cited in the preceding section, it would seem, give 
substance and specificity to Bouldmg’s views Along with other writers 
cited in that section, Bouldmg, m stressing the imaginal or cognitive 
aspect of learning and experience, also acknowledges evaluation and 
motivation, and, using gestalt-like, orgamzational concepts, he tries 
to show throughout his book how the tw^o relate and interact This is 
also a challenge to the more segmental, neobehavioristic approach 
being followed in the present study, and the next section will be de- 
voted to a sort of “case study” of this problem and its proposed solu- 
tion But what has already been said will indicate that our approach 
is one which, while firmly based upon principles which are empirically 
demonstrable with rats, also meaningfully articulates with those more 
intricate and more readily demonstrated operations in men which go 
under the name of knowledge, memory, imagination, and the like ® 

However, over against this growing recognition of the legitimacy 
of the concept of imagery in systematic behavior theoiy (see also 
Miller, 1959, and Woodworth, 1958) is Browm’s (1958b) repudiation 
thereof As indicated m Chapter 4, Browm quite rightly holds that 
emotions alone cannot provide an adequate basis for word meanings, 
and we can equally well agree that Watson’s theory that “meanings 
are implicit [speech] responses originally elicited by referents and then, 
through association, by words” (p 97) is also untenable Having long 
since rejected the notion that overt behavioral responses are directly 
conditionable, we would be on weak ground to accept a coveit vei- 
sion thereof But Brown goes further than this and maintains that the 
situation is not improved by the introduction of imagery as a vehicle 
of meaning He says 

®For an excitingly simiLr approach to these and related problems, see Pla 77 s and 
the Structure of Behavior, by Miller, Galanter, & Pribram (i960) Working in 
complete formal independence, these writers have produced a book with almost 
uncanny resemblance, in certain important ways, to the present one Although 
there is now no opportunity to make more than this brief allusion to it here, the 
reader will profit greatly if he uses the Miller-Galanter-Pribram book for collateral 
reading in connection with this and the tu^o following chapters, particularly 
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A man who has heard dogs named becomes able to identify dogs for 
himself and to distinguish them from other kinds of things It is natural to 
suppose that this performance is possible because the man has formed a 
mental image of the dog which he can match against any animals presented 
to his vision The next step is to suggest that the meaning of the word dog 
is the same mental image, the click of comprehension is the image that the 
word evokes However, there is a second change of behavior to be seen in 
the man w^ho has heard dogs named He begins to respond to the word as he 
formerly responded to the referent, to treat the word as a sign of the thing 
If, for example, he has always run away from the animal he may now run 
when someone simply shouts out the word Ordinarily w^hen we under- 
stand words in reading or in listenmg to speech we do not make any obvious 
response like running away but perhaps we do make some mternal sign 
reaction, perhaps the click of comprehension is some subtle response of a 
muscle or gland It will be argued m this chapter that neither of these 
notions of meaning is acceptable If there is an immediate elfect that consti- 
tutes understanding of a meaningful form that effect must be neuro- 
physiological There is nothing in consciousness or in behavior that is set 
off whenever the comprehended form occurs Psychological semantics 
must operate for the present with regard to the two kinds of overt action 
that are produced by reference and leave the “click” to neurology (p 83) 

Brown then gives a detailed account of the whole theory of imagery, 
particularly as developed by Titchener (1909a) and his students, and 
advances various criticisms of which many are patently trivial For 
example, he ridicules, quite justifiably, Titchener’s reported image of 
the word, “but ” “Titchener’s image of ‘but’ was of the back of the 
head of a speaker who often used this word while Titchener sat be- 
hind him on a platform ” And when Brown says that such (“acci- 
dental”) images are “unacceptable as the meanings of words,” we can 
only agree But the point is, “but” is not a noun and not a symbol in the 
fullest sense of the word It could never be the subject of a sentence 
(except if, as in metalmguistics, we were referring to the wordy “but”) 
and therefore does not ?ieed to have a meaning in the referential sense 
It IS, rather, a sort of verbal signal which does not represent anything 
but instead says to the hearer (or reader) “Hold on a moment, a quali- 
fication is needed More is to come ” 

Brown also goes wide of the mark in tacitly assuming that images 
must necessarily be visual Theoretically they can occur in any sense 
modality, and taste and odor imagery seem especially common Only 
a few days ago the writer and a colleague were discussing this prob- 
lem, and the latter remarked that, as a result of having been given castor 
oil in orange juice as a little girl, his wife can still sometimes “taste” it 
when she drinks pure orange juice And many similar examples could 
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be cited Thus, the fact that a particular word does not call up a visual 
image does not prove that no imagery whatever is involved 

But Brown is hardly a disinterested observer as far as images are 
concerned As indicated in section VIII of the preceding chapter, he 
favors a “dispositional” theory of meaning which makes meaning con- 
tingent upon word constellations rather than upon a special reaction of 
some sort to a specific word However, our whole approach to lan- 
guage IS different, and we find the concept of imagery highly useful 
rather than superfluous It is fortunate that someone with Brown’s in- 
terests and skills has explored the approach which he advocates, but 
his rejection of imagery is not such, on either empirical or logical 
grounds, as to lessen substantially its usefulness and validity for our 
purposes A specific, nonlinguistic example of its relevance in con- 
temporary behavior theory will be given in the following section 

III The Image and Weinstock^s Interpretation of 
Partial Reinforcement 

As already indicated (Mowrer, i960, Chapter 12), the fact that in- 
termittent, or “partial,” reinforcement during acquisition produces a 
habit with heightened resistance to extinction has stimulated and chal- 
lenged contemporary concepts of learning in a variety of ways At face 
value, this phenomenon seems to impugn the whole notion of rein- 
forcement and to demand the introduction of cognitive principles In 
Chapter 12 it has been shown that the so-called “discrimination hy- 
pothesis” seemed to be the most adequate explanation of this effect 
advanced to date, but at that stage of development of our analysis 
certain issues remained unresolved which may now be handled more 
adequately, so we return to this problem with special reference to a 
study reported in 1954 by Weinstock As also noted in Chapter 12, this 
investigator has shown conclusively that the partial-reinforcement 
effect IS not contingent upon the massing of acquisition trials (as the 
theories of Hull, 1943, and Virginia Sheffield, 1949, would seem to re- 
quire) In fact, Weinstock found that successive trials may be sepa- 
rated by as much as 24 hours and still show this effect, as indicated in 
Fig 5-1 (see also Wilson, Weiss & Amsel, 1955) Weinstock’s own in- 
terpretation of these findings runs as follows 

The author [assumes] that the competing responses which the animal 
makes m the goal box [at the end of a straight alley] on a nonremforced 
trial habituate during the course of a series of nonremforced [acquisition] 
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trials Thus, partially reinforced animals, which have had some number of 
nonremforced trials during acquisition, will have their competing responses 
to an empty goal box habituated to some relatively low level The competing 
responses, ha\mg habituated, will occur with a low frequency, and there 
will be little decrement m the strength of the original response due to the 
presentation of a nonremforced trial 

The decrease m frequency of competing responses seems to be visible m 
the behavior of the partially reinforced animals On early nonremforced 
trials they go to the food place, find no food, and run about the goal box 
On later nonremforced trials the runnmg-about behavior has dropped out 
and the animals remain m the vicinity of the food place (p 321) 

Although couched in a somewhat oveily “objective” terminology, 
this statement contains the nub of a potent idea In Chapter ii of 
Learning Theory and Behavior, the suggestion has already been ad- 
vanced that extinction is really a form of counterconditioning, in which 
hope (habit strength) is counteracted by the frustration which results 
from the nonfulfillment of the subject’s expectations Recast, then, in 
these more subjective terms, what the Weinstock hypothesis means is 
that in intermittent reinforcement, the subject’s tendency to be dis- 
appointed or frustrated when reaching the goal box and finding it 
empty (1 e , when primary reward is completely eliminated) has it- 
self been largely “extinguished” during acquisition, and the reaction of 



Trials 

Fig 5-1 “Mean reciprocal running time during extinction The initial, uncon- 
nected points are the means of the last block of five acquisition trials” (Weinstock, 
1954, p 320) 
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frustration which normally countei conditions hope has likewise been 
extinguished so that hope continues relatively unabated (cf Zimmer- 
man, 1959, for a related interpretation) It is, in fact, almost axiomatic 
that if, in the face of continued failure, an organism can be kept from 
becoming frustrated and hopeless, it will remain hopeful and ‘‘habit- 
ful ” This apparently, then, is what intermittent primary reinforce- 
ment during the acquisition of a habit does it habituates out the frus- 
tration reaction before “extinction proper” starts and so eliminates the 
factor which, in extinction following continuous reinforcement, rapidly 
counterconditions the hope reaction (see Chapter 8, Sections VII and 
VIII) 

But this explanation, intuitively appealing as it is, glosses over a 
crucial question namely, if extinction is a matter of countercondition- 
ing, what IS It that is responsible for the extinction of the frustration 
reaction during intermittent reinforcement^ It must, per hypothesis, 
be the reaction of hope, and yet, in the Weinstock experiment, suc- 
cessive trials are so fai apart that it is unthinkable that the frustration 
experienced as a result of finding an empty goal box on one trial could 
be in any way influenced by the experience of finding food therein on 
the next trial, 24 hours later Hull (1943) and Virginia Sheffield (1949), 
in studies cited by Weinstock, had in fact hypothesized that partial 
reinforcement might owe its special effectiveness to a persistence of a 
stimulus trace fiom one (nonrewarded) trial to the next (rewarded) 
one But a stimulus trace 24 houis long is out of the question, and 
Weinstock is quite right in holding that his data invalidate any such 
hypothesis However, by introducing the concept of imagery (not to 
be confused with r^ or rg), a new hypothesis emerges with none of the 
difficulties ]ust cited 

One may reasonably suppose that after a rat has run down an alley- 
way a few times and received food in the goal box, it will begin to 
have an image of goal-box-with-food as it later negotiates the runway 
But now the rat, for the first time, makes a run and finds no food 
Lively frustration will piesumably ensue On the next trial, as the rat 
runs down the alley it remembers (images) the empty-box experience 
from the preceding trial and, immediately, enters the goal box and 
finds food Thus image-of-empty-goal-box is closely associated with 
reward, and when, on a later trial, the goal box is again found to be 
empty, there will be a generalization of the hope reaction from the 
image to the real thing The result^ The subject will react to the empty 
goal box much as if its last experience therein had been shortly fol- 
lowed by a trial in which food was found’ In other words, by positing 
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the imagery mechanism previously described in this chapter, one can 
account for the effects of partial reinforcement where acquisition 
trials are widely distributed in time, no less well than when they are 
temporally massed ® 

But do we not have an embarrassment of riches, as far as possible 
explanations of this phenomenon are concerned? In Chapter 12 of 
Learnnig Theory and Behavior considerable evidence has been advanced 
in support of \\'hat is there called the Discrimination Hypothesis, and 
now we have derived a seemingly quite different type of explanation 
But are they really so different? Where reinforcement during acquisi- 
tion of a habit has been contiguous, the only image the subject has of 
the consequences thereof is one of reward, and once extinction has 
started, that image is suddenly and consistently controverted by the 
fact of nonreward Discrimination is precise, and counterconditiomng 
of the hope built up during acquisition is maximal On the other hand, 
where reinforcement during acquisition has been intermittent, the sub- 
ject’s image of what will follow a particular action is highly ambigu- 
ous acquisition and extinction are hard to discriminate, and, as we 
have seen, the frustration response to the experience of nonreward 
has been associated with subsequent reward and therefore rendered in- 
effectual as a source of counterconditiomng of the habit’s original 
strength 

Thus It would appear that we are here describing one and the same 
process in two different vocabularies And the use of the concept of 
image as a conditioned sensation has been crucial in enabling us to 
make this integration 

IV Reflex Arc or Image"^ 

In 1896 John Dewey wrote an article, “The Reflex Arc Concept in 
Psychology,” which was strangely prophetic In Chapter i of Learn- 
ing Theory and Behavior we have already quoted from this paper to 
the effect that, in its writer’s opimon, the reflex-aic idea then held 
promise of becoming the model on which psychology would be re- 

®If It seems that we are going too far m attributing imagery to animals, see 
Chapter ii of Ape tn Our House, entitled “The Very Strange Case of the Imagery 
Pulltoy” (Hayes, 1951), also Freides (1957), Kendler, Pliskoff, D’Amoto, & Katz 
(1957), and Petnnovitch & Bolles (1957) The latter, for example, say “Tradi- 
tional S— R mechanisms do not appear capable of explainmg this behavior There- 
fore, It seems reasonable to assume that some sort of symbolic process underlies 
It We suggest that rats can remember where they went last, and that this memory 
serves as the cue for the correct response” (p 365) 



IMAGERY, MEMORY, AND ATTENTION 179 

systematized That promise was fulfilled in the movement which was 
to be known as Behaviorism But, most remarkable of all, the author 
went on to point out certain crucial ways in which the reflex arc is 
conceptually incomplete and inadequate, ways which only today, more 
than sixty years later, are being seen and fully appreciated 

Conditioning, as conceived by Pavlov, was franWy a form of reflex- 
ology and, implicitly at least, so also was Thorndike’s connectiomsm 
Step by step, in earlier chapters, we have traced out the weaknesses of 
these two conceptual schemes, as originally formulated, and have con- 
cluded that what Thorndike thought of as a “connection,” or “habit,” 
probably involves (a) the conditioning of certain emotions to certain 
patterns of stimulation and (b) something we can hardly avoid calling 
volition or choice (see Chapter 6) Here the notion of continuous 
feedback from action is crucially important, and we come to see that 
not only does stimulation cause response (through the mediation of 
consciousness) but also that response causes, and is inherently associ- 
ated with, stimulation It is true that the reflexologists made a good 
deal of “reflex chaining,” as they called any sequence of actions 
wherein one response produced stimuli that cued oif the succeeding 
response But this is something quite different from the notion that an 
action, zuhile tn progress, is under the control of its own stimulus con- 
sequences This Dewey saw with prescient clarity 

Dewey’s paper is closely reasoned and not easily paraphrased or 
summarized Perhaps his argument is most concisely stated, in his own 
words, thus 

The distinction of sensation and movement as stimulus and response 
respectively is not a distinction which can be regarded as descriptive of 
anything which holds of psychical events or existences as such The only 
events to which the terms stimulus and response can be descriptively applied 
are to minor acts serving by their respective positions to the maintenance 
of some organized coordination The conscious stimulus or sensation, and 
the conscious response or motion, have a special genesis or motivation, and 
a special end or function The reflex arc theory, by neglectmg, by ab- 
stractmg from, this genesis and this function gives us one disjomted part of 
a process as if it were the whole It gives us literally an arc, mstead of a 
circuit, and not givmg us the circuit of which it is an arc, does not enable 
us to place, to center, the arc This arc, agam, falls apart into two separate 
existences havmg to be either mechanically or externally adjusted to each 
other (p 364) 

How amazingly modern all this sounds^ The older machines, of the 
nineteenth century, which were man-operated, did indeed involve 
“reflex arcs” with the “circuit” having to be completed by the opera- 
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tor But m present-day automata, the circuit is completed njoithi7i the 
vmchine^ thus pio\iding the capacity for self-regidation which, as 
Dewey knew full well, living orgamsms have long possessed And 
how, piecisely, is this achieved^ In any final and complete sense, w^e 
do not know^ But we have now^ firmly identified three important 
variables primary motivation (compaiable to the “driving force” of 
a maclune), secondaiy drives and rewards which control and guide 
action as it occuis, and a standmd or ^^miage"''^ of some sort which is 
being constantly compaied with actual performance (cf Chapter 7 ) 
As earlier chapters of this book indicate, a good deal is now^ known 
about the lelationship between primary and secondary drive, but we 
aie less clear as to how^ images fit into the picture On this score Bould- 
ing has the following to say 

In a sense, we may say that the concept of the “image” begins in a very 
rudimentary form at this [the physical and physiological] level The 
thermostat has an image of the outside world m the shape of the informa- 
tion regarding its temperature It has also a value system in the sense of the 
ideal temperature at which it is set Its behavior is directed toward the re- 
ceipt of information which will bring its image and its value system to- 
gether When Its image of the outside world is “right,” that is, conforms to 
Its \alue system, it ceases to act As long as the image, as confirmed by the 
messages received, does not conform to its value system it acts in order to 
bring the two together Here, therefore, even below the biological level we 
see a concept something like that of the image in operation (p 22 ) 

While the foregoing may leave something to be desired in the way 
of explicitness, yet the conception tow’^ard w^hich the author is pointing 
is clear enough behavioi is not just a mattei of “blind power” — it also 
involves intelligence and knowledge In the following section an at- 
tempt wull be made to be more specific about this point of view 

V All Behavior as Scanning or Sensory Search 

It is manifestly tiue that some activities are more conspicuously 
“sensoiy” w^hile others are moie conspicuously “motor,” but each has 
both Its sensory and its motor aspects When an organism moves its 
eyes (or head) about so as to survey its visual environment, it is said 
to be lookmg, and here the matter of seeing, or perceiving, is accented, 
although no one would deny that the subject is also moving, acting, 
behaving Contrariwise, w^hen a man moves his arm, he is said to be 
domg something, but his arm, too, cairies sense organs which, by 
virtue of the arm’s movement, are stimulated When the sense organs 
are prominent and the manipulating muscles small, we use one vocabu- 
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lary, and when the muscles are large and the sense organs small, we 
use another But surely it is sufSciently evident that perceiving involves 
doing and that doing involves perceiving, sensing One without the 
other IS futile Saying that an individual “doesn’t know (perceive) 
what he is doing^^ is tantamount to charging him \\ ith idiocy or mad- 
ness, and to perceive without being able to do is to be paialyzed 

The view that all behavior is thus mheiently sensoiy oi perceptual 
is, in fact, virtually demanded by the conception of habit which has 
been developed earlier, wherein action is guided and directed, not by 
fixed sensory-motor pathways, but by hopes and feais that have become 
conditioned to response-correlated stimuli — or to what we may now 
think of as good and bad “images ” But the applicability of this way 
of thinking to so-called perceptual activities did not suggest itself until 
the author chanced to read the opening sentences of an article by 
Fredericson (1950) entitled “Cognitive Maps and Reinforcement” 

Reference to a type of disruptive activity which occurs when a previously 
obtained goal object is no longer accessible has been made by Tolman 
(1938) He described the rat’s behaviour under such conditions as a form of 
searching and exploration (p 253) 

This passage, particularly the last sentence, suggests that, if our basic 
assumptions in this book be true, all behavior is “a form of searching 
and exploration” This seaichmg may be gross and obvious, as in so- 
called trial-and-eiror behavioi, 01 it may be refined and delimited, as 
in a violinist trying to get just the right quality of tone and shading as 
he performs (plays) a strictly prescribed series of reactions (notes) 
But, in principle, both involve “seaichmg and exploiation ” Stanley & 
Aamodt (1954) have recently reported a study (cf Mowrer, i960. 
Chapter 1 1 ) which provides expeiimental illustration of and support 
for this point of view They state their problem thus 

Two article (Applezweig, 1951, Maatsch, Adelman, & Denny, 1954) 
have recently criticized experiments designed to test the fatigue (Miller 
and Dollard, 1941, Mowrer and Jones, 1943) or reactive inhibition (Hull, 

"It may at first appeal that this fusion of perceiving and doing is invalidated 
by differences in the extent to which these activities are “informative” as opposed 
to “instrumental” Looking at or seeing something does not change that thing — 
It merely informs the looker, whereas, in doing something, we are likely to change 
the external world, not just ourselves While there is here unquestionably a differ- 
ence in degree, it is by no means categorical In adjusting a sense organ, we in- 
evitably “disturb” the environment in at least some minimal way, and when we 
set out to produce more striking effects of the latter kind, perception, as we 
have seen, is sail involved Thus the interplay between doing and perceiving 
seems to be continuous and inescapable 
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1943) theories of extinction because these experiments failed to control 
“habit strength”— specifically, force requirement per response durmg con- 
ditioning According to this criticism, two studies (Mowrer and Jones, 
1943, Solomon, 1948) interpreted as supporting fatigue or inhibition theories 
of extinction may be regarded as demonstrating that requiring forceful re- 
sponses during conditioning yields forceful responses during extinction It 
IS a further implication of this criticism that if a reinforcing stimulus is 
made contingent on weak responses, then weak responses should occur 
during extmction 

It was the purpose of the present experiment to determine the validity of 
both these hypotheses Specifically, it was expected that force requirement 
during conditioning would be positively related to forcefulness of respond- 
ing durmg extinction (p 462) 

In the experiment which Stanley & Aamodt carried out, it was in- 
deed found that their subjects (laboratory rats) showed greater re- 
sistance to extinction with regard to a bar-pressing habit if, during 
extinction, it took the same force to operate the bar as had been re- 
quired during the original (food-reinforced) training, if the force re- 
quirements were different during extinction, there was a reduction in 
the resistance to extinction What these findings seem to mean is that 
during acquisition a specific pattern and intensity of kinesthetic stimu- 
lation had taken on secondary reinforcement properties When, during 
extmction (absence of primary reinforcement), a response recreated 
this same pattern of stimulation, it produced more secondary rein- 
forcement (hope) and was therefore more resistant to extinction than 
when a response resulted in a different pattern of kinesthetic stimula- 
tion All of which suggests that the bar-pressing habit here consisted 
of a tendency to search for, and to be secondarily reinforced by, a 
particular type and intensity of stimulation or sensation 

A modification of the Stanley-Aamodt experiment would make the 
point even more clearly Suppose, for example, that one group of rats 
were trained to press a bar for food which required 20 grams of effort 
and that the bar used with a second group required 100 grams of 
effort Now, during extinction, the bar is no longer counterbalanced 
by a weight but by a spring This would mean that the bar could be 
pushed with whatever amount of effort the subject desired to use The 
experimental findings already cited, as well as common sense, would 
certainly lead us to expect that, in the extinction procedure, the sub- 
jects would search out that particular pattern of kinesthetic and tactile 
stimulation which, during training, had been reinforced and would 
avoid making responses that resulted in a different sensory pattern 
This expectation derives from the principle (discussed in Chapters 7 
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and II of Learning Theory and Behavior) which holds tnat “habit 
strength” is a function of the extent to which a response continues to 
reproduce the same stimuli that were produced when the response 
previously occurred and received primary lemforcement 

In Chaptei 6 we shall discuss the head-wobbling that a rat tends to 
engage in at the choice points in a maze oi a discrimination apparatus 
This has commonly been referred to as vicarious^ oi diminutive, trial- 
and-erior behavior Here the element of “searching and exploration” is 
obvious, as It IS in other activities whose most patent function is the 
play of sensory organs, as is “looking around” or “listening ” But now 
we also have empirical as well as logical justification for supposing that 
behavior generally functions in much the same way, it, too, is a form 
of searching, a searching for the particular stimuli which, on prior oc- 
casions, have been followed by basic satisfactions Thus, an organism 
which has a “habit” or a “skill” is simply an organism that “knows 
what he’s looking for ” Otherwise, if he doesrCt know, his behavior is 
random and aimless What the skillful, informed, habitful organism 
does, in effect, is to seek those stimuli (response-correlated and inde- 
pendent) which, in Tolman’s teims, are now “demanded” or, in other 
words, can provide secondary reward and will, in all likelihood, lead 
the organism to primary satisfaction This way of thinking carries us 
considerably beyond the reflex-arc concept and behavioristic thinking 
generally and points to problems which will be further considered m 
the ensuing sections (see also Chapter 7) 

VI Perception, Performance, and Evolution 

Repeatedly in this book we have found that contemporary writers, 
with the most divergent backgrounds and on the basis of seemingly 
quite independent data, are tending to converge upon a common point 
of view concerning learning and behavior theory An interesting ex- 
ample of this confluence is found in an aiticle by Campbell (1956a) on 
“Perception as Substitute Trial and Error ” This wiiter’s own summary 
of his argument runs as follows 

Selective survival among random variations is taken as a general paradigm 
for instances of organismic fit to environment Darwinian theory of natural 
selection applies the model to the fit between the inherited characteristics 
of organisms and the opportunities provided by their habitats Trial-and- 
error doctrines apply the model to learned fit between organismic response 
and environment Ashby (1952) and Pringle (1951) have independently 
noted the formal parallel between evolution and learnmg [see also Skinner, 

1953a] 
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Attention is called to a third level of orgamsmic fit to environment, in 
the adaptive responses employed in the flexible execution of well-learned 
habits For blind organisms, the trial-and-error component in the carrymg 
out of a habit may be obvious, but for organisms with distance receptors, 
the smoothly guided vet flexible character of the execution of learned re- 
sponses seems quite out of keeping vith the random variation required by 
the model An effort is made to resolve this incongruity by characterizing 
perceptual processes as substitute trial and error, contammg a search com- 
ponent which takes the place of blmd overt motor movements The notion 
IS a more primitive one than that of ‘Sicarious trial and error” It seems 
relevant for the empirical inconsistencies in the problems of “what is 
learned” and “insight” As related to servo-mechanism models, the notion 
is to be clearly distinguished from the simple negative-feedback regulators, 
like thermostat or governor, in which the feedback comes from the outcome 
of the primary effector But a suggestive parallel is available in complex 
servo-systems such as the radar-controlled guiding of a ship or projectile, 
in which a blindly emitted beam is selectively reflected, and is used to 
substitute for a trial and error of ship movements or projectiles (p 341) 

Campbell’s aigument might be paraphrased somewhat as follows In 
oigamc evolution there is a struggle for existence, or “trial-and-error” 
process, in a population of individuals Some individuals, showing 
favorable organic (structural) variations, survive best and reproduce 
themselves most abundantly, thus diffeientially “stiengthenmg” or 
“reinforcing” these vaiiations In trial-and-error learning much the 
same principle is involved successful responses are perpetuated and 
unsuccessful ones are discarded, 1 e , they do not “reproduce them- 
selves” Here, however, the competition, selection, or “struggle” is 
between a population of respofises, rather than of individuals, and the 
deviations inv^olved are functional rather than structural It was there- 
fore a great advance when this type of vaiiation became possible, for 
in organic evolution an “error,” being structural and uncorrectable in 
the individual, meant death 01 at least serious disadvantage, whereas, 
with learning, an erroi can often be abandoned and replaced by more 
suitable action Epitomizing, vv e may thus say that learning is a form 
of / 77 organic evolution, or change, in the sense that it involves no gross 
bodily modifications and such modifications (in the nervous system) 
as aie required can occur very quickly — millions of them, in fact, 
within the lifetime of each individual 

Surely, despite significant differences, the similaiities between the 
theory of oigamc evolution and Thorndike’s theory of learning are 
striking In a footnote Campbell says 

The parallel between natural selection and trial-and-error learning 
seems obvious, once pointed out, and yet it is an important and profound 
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intellectual achievement It is interesting to note that Lloyd Morgan and 
E L Thorndike, who were imbued with the Darwinian heritage and were 
proponents of the trial-and-error doctrine, seemed to miss it, or at least 
did not make it explicit Ashby and Prmgle, both participating in the intel- 
lectual ferment out of which cybernetics and information theory have 
developed, seem to have noted the parallel independently (p 331) 

But Campbell, in the article cited, is saying something more While 
structural variation was useful to a species in helping it fit more snugly 
into a particular physical environment, the ‘'searching and explora- 
tion” thus involved was of a drastic and often, liteially, fatal kind In 
plants, where structure is maximally important and “behavior” mini- 
mally so (see Fuller, 1934), change occurs almost entirely by means of 
the evolutionary mechanism, but in animals, with nervous systems and 
the attendant possibility of response variation, there is the capacity 
for another kind of “evolution” or change, namely learning But this, 
says Campbell, is not the end of the matter Learning by actual doing 
involves hazards, and a still higher level of advantage accrues to or- 
gamsms which can explore their environments, not only in terms of 
actual, overt performance, but also perceptually What, more precisely, 
does this involve^ Campbell’s answer runs as follows 

Let us consider a blind person who has learned the task of sorting mixed 
machme parts mto separate bins The response of reaching is for the most 
part a body-consistent response, guided in terms of body orientation and 
memory The final phase of the grasping, however, involves an observable 
blmd, random groping, varying in extent depending upon the accuracy of 
the mitial movement Without the trial-and-error component, the object- 
consistent adaptive fit of the response would not be achieved An example 
of a blind, fumbling, yet object-consistent response for a seeing person 
might be finding a cigarette lighter in a pocket But even for a blind 
person’s behavior, this random trial-and-error aspect of executing well- 
learned behavior may not be too apparent In part, this is due to the fact 
that, m a simple stable environment, body-consistent responses may ap- 
proach fit quite closely, leaving the random trial-and-error component to 
a minimum Thus m walkmg on a well-known level floor, the blind person 
may place each foot without hesitation, or visible trial and error And on an 
uneven terrain, the random trial-and-error component may be safely 
hmited to one dimension, and appear only as a hesitant feelmg for the 
ground But if we are to follow the logic of Ashby’s presentation, and 
avoid any unexplamed prescience on the part of the organism, the random 
trial-and-error component must be present m every object-consistent 
response 

Let us follow further our blmd subject m his well-learned performance 
He identifies the piece by a random scannmg of its surface with his fingers 
He places it without apparent hesitation in the correct bm, if the bins are 
large enough for a body-consistent response to be adequate But if we 
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observe him more closely, we note that he has searched out the correct bm 
with his left hand, and that this has given confidence and precision to the 
response of the right Somehow, the random trial and error of the left 
hand has vicariously served for the right one Similarly, he may in walking 
use a blind trial and error of cane movements to search out steps, walls, and 
doors, reducing the trial-and-error component m his walkmg 

But most object-consistent responses have a smooth, accurate, guided 
quality which seems quite out of keepmg with the prescribed random 
trial-and-error process If the formal model for adaptive fit is to be retained 
at this level, the only resolution seems to be to locate the trial-and-error 
process in the function of the sensory organs It is the burden of this paper 
that perception serves this function of trial-and-error exploration, sub- 
stitutmg for the motor trial and error found m the blind object-consistent 
response 

It IS probably easiest to accept this pomt of view for an organ of vicarious 
exploration like an insect’s antenna, or the blmd man’s cane The analogy 
of the radar screen as an aiming device is of help The radar beams scan 
the sky in a blind sweep, blmd m that it is not modified by any prior 
knowledge of the location of objects When in this search a beam reflects 
from a plane, a gun is then appropriately aimed The trial and error of a 
radar beam has substituted for a trial and error of expensive bullets In a 
parallel way, a ship’s radar vicariously explores the waterways, by a trial 
and error of radar beams learnmg the location of obstacles that might other- 
wise have been located by a trial and error of ship movements and collisions 

It IS an easy transition from the radar model to the bat’s supersonic echo 
location — which sound waves emitted m all directions provide the substi- 
tute random trial-and-error process Similarly, the lateral line organ of fishes 
seems to have the purpose of registermg waves of water pressure change 
m such a fashion as to locate objects m terms of the echo of the fish’s own 
swimming, and Pumphrey (1950) has suggested the radar and echo-location 
analogy for this process [see also research on porpoises by Kellogg, 1958] 

The case for vision is most important, but cannot be made with the 
clarity and completion possible for the radar and echo-location examples, 
since the emitting process is missmg However, the notion of vision as a 
surrogate trail-and-error process seems not only required by the formal 
model but supported by other considerations If in visual search the gross 
eye movements are not blmdly searchmg it is because other sources of 
information such as touch, memory, or hearmg have been emploved to 
narrow the range of search Hebb (1949) has assembled impressive data on 
the active searching movements that typically characterize the simplest 
seeing process, and his facts belie the implicit notion of the passive, fixed- 
focus eye implicit m both Gestalt and conditioning theories But even 
without temporally extended scannmg, the eye m a single glance provides 
spatial information which can substitute for motor trial and error, which 
can lead to smooth, guided, object-consistent responses (pp 334-336) 

In this section we have conjectured that, despite their apparent 
differences, “perceptual” and “motor” responses are fundamentally 
similar, serving the same functions and being controlled by the same 
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laws There is, however, a difEculty which arises in this connection 
which will be considered in the following sections 


VII ''Information^' and Learning Theory 

As we now see, there is considerable justification for believing that 
the behavior involved in the scanning, focusing, and related “adjust- 
ments” of sense organs is not basically different from so-called instru- 
mental or habitual behavior in general In this section we shall review 
some of the experimental evidence for and against this assumption® 

In 1952, Wyckoff published a seminal paper on “observing re- 
sponses” in the pigeon which may usefully serve as our point of de- 
parture This investigator found that pigeons would step on a small 
treadle which in no way influenced the accessibility of primary rein- 
forcement but which did provide certain “information” about the con- 
ditions under which leinforcement could be obtained And Wyckoff 
(following suggestions previously put forward by Skinner, 1938, and 
Dinsmoor, 1950, see also Mowrer, i960. Chapter 12) concluded that 
the treadle response was learned because information (in the sense of 
cues) has secondary-reinforcement properties However, the details of 
both the theoretical and the empirical aspects of WyckofFs study are 
too intricate for full examination heie, so we turn to a somewhat 
simpler attack on the problem published by Prokasy in 1956 He sets 
forth the objective of his study as follows 

The present study was designed to determine if exposing a rat to discrim- 
inative stimuli in a maze also has a remforcmg effect More specifically, 
the purpose was to test the hypothesis that rats would show a preference 
for conditions enabling them to “anticipate” the presence or absence of 
food over conditions not enabling them to “anticipate” the presence or ab- 
sence of food, when the average amount of food resulting from a choice 
of either condition was the same Smce a response which allows “anticipa- 
tion” is analogous to an observing response m Wyckoff^s study, this ex- 
periment is another test of Wyckoff ’s basic hypothesis (p 131) 

The maze employed by Prokasy was shaped like the letter E, with 
the starting box in the center stem and goal boxes at the ends of the 
two wings Food was available in each of the two goal boxes on 50% 
of the trials, and there was a delay chamber in each wing, just anterior 
to the goal box, where the subject was detained briefly, on each trial, 

® It goes without saying that the present chapter does not provide anything like 
a complete account of the topic of perception For more comprehensive treat- 
ments, see F H Allport (1955) and Bartley (1957) 
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before being allowed to proceed to the goal box On one side of the 
maze the delay chamber was always the same color as the rest of the 
maze, namely gray, whereas, on the other side, the delay chamber was 
white on trials when food was to be obtained in the goal box and black 
when it was not (or vice versa) The results are shown in Fig 5-2 



Fig 5-2 Curve showing the emergence of a preference (on the part of rats) for 
that side of an E-maze in an experiment wherein there was foreknowledge of 
presence or absence of reward in the goal box (Prokasy, 1956, p 132) 

Here it is apparent that the subjects (rats) eventually developed a de- 
cided preference for the side of the maze where they were “tipped 
off,” by the color of the delay chamber, as to whether leward would 
be forthcoming on any particular trial — and this despite the fact that 
no more food was, on the average, available on this side of the maze 
than on the “noncommittal” side In other words, the subjects seem 
to have been rewarded by “advance notice” of whether reinforcement 
would or would not be available in the goal box This finding confirmed 
Wyckoff’s hypothesis that “information” is rewarding, but it did not 
greatly explicate theory ^ 

Perkins (1955) has suggested that information is rewarding for the 
reason that it helps an orgamsm prepare for future events But we can 
be considerably more explicit in this connection if we think along the 

®Cf Dashiell’s (1938) remark regardmg the Muenzinger shock-right effect 
(Movtrei, i960, Chapter ri), that “we ha\e let oursehes be surprised at this ‘shock- 
right’ phenomenon, but the surprise is due to our ha\ing emphasized the word 
‘shock’ and not the word ‘right’” (p 213) (Cf also Osgood, 1953, pp 424^, 
Deese, 1952, p 116 ) 
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following lines We may reasonably suppose that in the Prokasy ex- 
periment the information received in the delay box on nonrewarded 
trials would keep the frustration reaction in the goal box from being 
as intense as it was on the nonrewaided trials on the other side of the 
maze Therefore, in keeping with inferences drawn in connection with 
the Weinstock experiment (see also Mowrei, i960, Chapter ii), the 
effects of nonreward on the informative side of the maze would 
cushion the resultant frustration and lessen the extent to which it 
would countercondition the phenomenon of hope (habit strength) 
The result would be that the secondary reinforcement or hope in- 
volved in going to one side of the maze would become stronger than 
that involved in going to the other side of the maze because the non- 
rewarded trials would be less frustrating on the first side than on the 
second Thus, what at first appears to be a tendency on the part of rats 
to “seek information” can be reduced to differential extinction of two 
initially equal response tendencies (see Chapter 9, Sections VII and 
VIII) 

VIII Observing Reactions in Situations of Danger 

However, “news” can be bad as well as good, and we must therefore 
confront what is at least superficially a dilemma If “observing reac- 
tions,” like behavior in general, aie controlled by reward and punish- 
ment, then if such reactions commonly result in the observing organism 
being frightened or perhaps more vitally “hurt,” one might expect such 
reactions to be inhibited, to stop occurring — and thus expose the or- 
ganism to even greatei danger and possible death 

In the winter, when there is snow or ice on the ground, the writer’s 
wife puts sunflower seeds on a feeding platform for the cardinals that 
live m our neighborhood Also, one of our neighbors keeps a cat that 
IS an excellent hunter Therefore our cardinals, when eating, behave 
as follows The head is lowered, the seed is taken between beak and 
mandible and quickly husked and swallowed, and the head is then 
raised so that the bird is in a better position to “look around ” After 
thus making sure that the “coast is clear,” the bud again lowers its 
head, and the cycle is repeated Ceitainly the cardinals do not want to 
see the cat, yet we are faced by the puzzle of why they nevertheless 
keep looking for him 

In a recent paper Liddell has collected a number of instances of 
“vigilance” in animals and human beings (see also Deese, 1955), of 
wluch the following, supplied by a seal hunter, is particularly striking 
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“When the sun becomes hot, the seal who is a chilly animal, will emerge 
from Its hole and stretch out on the ice There, three feet away from the 
opening, it sleeps, ready to slip back in at the slightest danger Every eight 
to ten seconds, the seal wakes up, lifts its head, looks around and goes back 
to sleep The Eskimo approaches on the flat empty plam He waits for the 
animal to go to sleep and then runs for about four or five seconds After 
which, he lies down on the ice and waits for the animal to wake up And so 
It goes Eighty yards away from his prey, the hunter changes his tactics 
Whenever the seal lifts its head to look around, the Eskimo lifts his head 
like the seal, he looks right and left with the same astonished expression 
Bemg nearsighted, the seal believes that it is face to face with another of 
Its kmd In this manner, the man can, if he is clever, come right up to the 
animal, grab one of its fins, and with his free hand, plunge his knife m 
the seal’s heart” (Liddell, 1950b, p 185 — quoted from de Poncins, 1949) 

One possibility is that such vigilant reactions as those ]ust described 
are essentially instinctive In what follows we are not at all excluding 
this possibility, but it will be our purpose to show, alternatively, how 
a reinforcement explanation might also apply Here, to use the example 
first given, we start with the not unreasonable premise that a cardinal, 
upon ahghtmg on the feeding platform, is (a) hungry and (b) some- 
what apprehensive So, upon alighting, the bird looks around, sees no 
cat, and feels safe enough to lowei its head and take a sunflower seed 
During the latter act, visibility is reduced, fear presumably mounts 
slightly, and the bird presently raises its head and looks about What 
It sees IS reassuring (fear-reducing), and it now feels safe enough to 
lower Its head and again eat, and so on This, it seems, is a conflict situ- 
ation in which two antagomstic responses are being alternately rein- 
forced the lowering of the head and eating, by hunger reduction, and 
the lifting of the head and looking about, by fear reduction Here, 
looking (vigilance) is far more frequently reinforced positively (by 
rehef of fear) than negatively (by seeing the cat), and so the dilemma 
is presumably solved 

^®For a fascinating account of the “observing reactions” of wild animals in 
Africa, see Moorehead (1957) 

^Elsewhere (1959b) the writer has suggested the same idea as follows “Because 
living organisms sometimes ‘look for trouble,’ in the sense of making ‘observing 
responses’ which may involve unpleasant discoveries, Woodworth (1958, p 249) 
sees here further support for his behavior-primacy and environment-learning 
prmciples, in opposition to homeostasis [see also Schlosberg & Solomon, 1943] 
It IS entirely possible that the observing reactions which are prompted by 
apprehension usually result in reassurance (Nothing there 0 and that the occa- 
sional ‘pumshment’ which comes when trouble is actually spotted is more than 
offset thereby Many wild thmgs, when captured and confined, do abandon their 
watchfulness, for nothing is then reassurmg, they experience only ‘alarm’ when 
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It will be recalled that m Chapter 12 of Learning Theory a 7 id Be- 
havior an experiment by Mowrer & Keehn (1958) was cited in which 
rats periodically turn a revolvable cage a few inches as a means of 
averting electric shock One would not ordinarily think of such be- 
havior as involving “observing reactions,” but the underlying mecha- 
nism seems to be much the same in both cases the organism does some- 
thing which makes it feel reassured, it then engages in some other 
form of behavior (during the course of which its fear mounts), and it 
again performs the reassuring action The same investigators, in a dif- 
ferent experimental situation involving the recurrent presentation of a 
visual danger signal, have been interested in the extent to which labora- 
tory rats will go to a particular place as a means of “watching for” 
this stimulus and will then go to another point and push a lever as a 
means of eliminating the danger signal (which can now no longer be 
seen) and averting shock Although rats show some prospect of being 
able to solve a problem of this kind, it seems to be extremely difficult 
for them Perhaps this problem will be attacked in the future with im- 
proved techmques — and more striking results But already enough has 
been done to show that the problem is amenable to experimental study 
and does not (as Coppock, 1954, has argued) necessarily carry us be- 
yond the principles which the study of ordinary instrumental behavior 
has revealed (see Section IX) 

In a paper entitled “The Influence of Complexity and Novelty in 
Visual Figures on Orienting Responses,” Berlyne (1958) has reported 
some findings with human subjects that are congruent with those al- 
ready cited Using visual figures which weie (a) simple and unambigu- 
ous, (b) complex, and (c) ambiguous, this investigator found that the 
subjects spent most of their time looking at figures in the (b) and (c) 
categories One interpretation which Berlyne suggests is that human 
beings have a “tendency to fixate a part of the environment that is a 

they ‘observe,’ and, likely as not, they close or otherwise cover their eyes and 
plaster down their ears” (p 13 1) The importance, for the reinforcement of ob- 
serving responses, of the subject’s being able to do something when trouble is 
discovered is further emphasized by the following experience which the writer 
soon thereafter recorded as follows “I was taking two postal cards to the De- 
partmental letter box In casually glancing at them, I found that I had failed to 
put air-mail postage on them — and it was urgent that they go air mail Mv first 
reaction was one of startle, then of relief an undesirable event had been avoided 
By seeing (observing) the effects m advance, I was able to circumvent them'^” 
Thus, even on those occasions when observing responses spot trouble, corrective 
action may occur which is very rewarding and remforces not only that action 
but also the observing behavior which made it possible 
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relatively rich source of information in preference to one that is a rela- 
tively poor one” (p 294) But perhaps a more telling hypothesis is that 
complexity and incongruity (eg, a bird with four legs or a cat wath 
an elephantine trunk) are puzzling, “uncertainty-laden” (Berlyne's 
teim), and theiefoie somewhat threatening until they arc fully ex- 
plored and “undeistood ” Pavlov’s conception of an “investigatory 
reflex” (1927) usefully denotes the facts but does not provide an ex- 
planation Such stimuli piesumably make the subject slightly uneasy, 
and he continues to explore them until he feels reassured Here, it 
would seem, much the same principles are involved as those cited 
earher in this section (cf also the concept of “mastery”) 

IX Observing Responses and Reinforcement Empirical Findings 
and a Theoretical Issue 

Since the foregoing sections weie written, two peitment experiments 
have appeared in the periodical literature and a third one has been 
carried out, by Mr Mohammed Akhtar, in the University of Illinois 
laboratories Lyman (1959), in a paper entitled “Signal Vigilance Level 
and Conditioned Avoidance Acquisition in the Goat,” after a brief 
historical introduction, reports a high correlation between “orienting 
responses” on the part of his subjects to the danger signal and learning 
of avoidance leg retraction Says Lyman 

The more vigilant the organism during signal period, the fewer trials 
required for avoidance acquisition In addition, the results show that the 
organism is more vigilant or alert during avoidance-response than during 
UR-signal periods (p 90) 

The data suggest that vigilance plays an important facilitating role in 
avoidance learnmg (p 91) 

However, the theoretical analysis of this study is weak, as indicated 
by the concluding statement “The suggestion is offered that vigilance 
allows for a more ready association of CS and sustained avoidance 
flexion” (p 91) 

The details of the expeiiment recently reported by Darby 8 c Riopelle 
(1959) are complicated, but the over-all purpose and outcome can be 
quickly indicated Various efforts have been made to get animals to 
learn by watching other animals, but the results have been ummpres- 
sive However, taking some leads from Harlow’s work on learning sets 
(Mowrer, i960. Chapters 10-12), these investigators found that by ex- 
posing one monkey to several hundred exhibits of another monkey 
working on different discrimination problems, the observer monkey 
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definitely profited by such exhibits in his own approach to the same 
problem Moreover, the extent to which such profiting occurs in- 
creases with practice and experience Here, once again, we see an indi- 
cation of the fact that observing (perceptual, ‘"cognitive”) behavior 
follows principles apparently quite similar to those which control more 
overt, gross types of behavior and that reinforcement theory, as de- 
scribed in this volume, readily articulates with problems of this kind 
This study also has the virtue of involving observing reactions m a 
situation wherein the primary reinforcement is decremental rather 
than incremental, as it is in the Lyman experiment and in the experi- 
ment by Akhtar which is now to be described 

Near the end of the preceding section, reference has been made to 
a preliminary study by Mowrer & Keehn in which rats received a 
visual warning signal in a situation so arranged that this signal could 
not be seen from the place where the actual avoidance behavior (a 
modified bar-pressing response) had to occur Although there was 
some tendency for the subjects to “go and watch” for the danger 
signal, this behavior never became highly proficient, in part, no doubt, 
because the danger signal “went off” (and type-i secondary reinforce- 
ment was experienced), not as the subject made the instrumentally 
effective response of pushing the bar, but m advance of this, as the 
ammal left his observing post and the danger signal (though still “on”) 
was lost from sight 

In order to investigate the same problem but under improved condi- 
tions, Mr Akhtar, under the writer’s direction, carried out the follow- 
ing experiment At irregular intervals (which averaged about a minute 
and a half), a rat received electric shock from the grill floor of a 
revolvable cage, and this shock had to be turned off by the rat’s re- 
volving the cage a minimum of two inches, m either directiOJi, by 
runmng However, if the rat, just before the shock came on, was facing 
m one direction in the revolvable cage, it received a warning signal 
in the form of a tone, whereas, if the rat was facing in the other direc- 
tion, there was no warning signal The theoretical question was simple, 
as was the empirical answer Will rats orient in such a way that they 
will receive the warning tone, rather than in a way in which they will 
not, and the answer is clearly, yes Receiving 15 trials per day, four 
of five ammals reached the criterion of proper orientation and success- 
ful avoidance of shock on all 15 trials on a given day, in 9, 13, 14, and 
34 days, respectively The fifth animal, at the end of 55 days, had not 
yet reached criterion and was discontinued The more 01 less “typical” 
performance of the 14-day animal is shown in Fig 5-3 
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Fig 5“3 Cur\e showing the increasing proficiency (learning) of a rat in orienting 
in a revolving cage in such a way as to receive an auditory warning signal and 
make a response which avoids an electric shock In thus “looking for trouble” 
(warmng signal), the animal has less of it (in the form of shock) in the long run 


Why did these animals learn to orient in the revolvable cage in such 
a way as to receive the danger signal, in preference to the reverse 
orientation m which they would not thus be “bothered”^ The fact is 
that the danger signal was, in the final analysis, not a “bother” in this 
situation, it was, in fact, decidedly helpful When orienting in the 
wrong direction, an ammal never “knew” when he might be shocked 
and so was more or less chromcally apprehensive When the shock 
came, the rat could, to be sure, always turn it off by running, but 
avoidance was impossible When, however, the rat oriented m the 
right direction, it could not only respond to the fear thus aroused 
with an anticipatory run (which would avert the shock), it could 
also sharply discriminate between the brief periods when it was in real 
danger (i e , when the tone was on) and the rest of the time, when 
the rat was perfectly safe and could well afford to “relax ” Hence, the 
reinforcements for being “realistic” and watching for the danger signal, 
rather than engaging in so-called ostrich-like behavior, are clear-cut 
and obvious The only surprising thing is that there was one rat, out 
of the five, which for some reason did not see the situation in quite 
this light 

In the hope of devising a still simpler way of attacking this problem, 
Mr Akhtar carried out a second version of this experiment A conven- 
tional Miller-Mowrer shuttle box was divided in the middle by a board 
with a small hole in it in which there was a swinging door (hinged 
from above), which was easy to pass through but which excluded 
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vision into the other side of the apparatus Again the warning signal 
was a tone, and it was available in only one side of the apparatus On 
alternate days, each rat was put into the apparatus on opposing sides, 
and all it had to do to solve the problem was to go to (or stay on) 
the side where shock was preceded by the tone and, when the tone 
came, to leap into the air slightly In 23 and 35 days, respectively, two 
out of four animals solved this problem to criterion, but two other 
ammals did not However, it was noteworthy that, although failing 
(refusing^) to make the necessary avoidance response of jumping, they 
nevertheless showed a clear preference for the side on which the shock 
was preceded by warning Although, for some reason, failing to termi- 
nate the danger signal by jumping and preferring not to jump until 
forced to by shock, they nevertheless apparently ‘'felt better’' on the 
side with the warmng signal (as indicated by more time spent there), 
for reasons already indicated in connection with the first version of this 
experiment 

Preliminary and crude as these two experiments were, they neverthe- 
less serve to indicate that observing reactions, even where a “negative” 
or “danger” signal is involved, follow expectations generated by re- 
vised two-factor learning theory and do not, at least at this stage of 
our understanding of this type of problem, call for new or different 
principles The paradox of behavior that seems to involve “looking 
for trouble” is resolved by the thought that if one looks for trouble, 
not in the sense of creating it for himself, but of knowing when to 
expect It and what to do then to avoid it, one is much better off in 
the long run Somewhat more analytically and formally, one may say 
that in being willing to be frightened occasionally (secondarily moti- 
vated), one is often able to avoid the greater evil of being more seri- 
ously hurt Thus, we stay well within established reinforcement prin- 
ciples and also within the conceptual framework of homeostasis in 
general 

As an after-thought it occurs to the writer that some readers may 
feel that the outcome of the Akhtar research was a foregone conclusion 
and that the attendant theoretical analysis is aimed at a straw man “Of 
course living orgamsms, if they have any sense at all, will make use of 
warmng signals^” — might seem a reasonable view of the matter But 
critics of reinforcement (homeostatic) theory have often voiced at 
least intimations of skepticism in this connection Fox example, Sid- 
man & Boren (1957), m an article entitled “A Comparison of Two 
Types of Warning Stimulus in an Avoidance Situation,” have this to 
say 
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Almost without exception, theoretical formulations of avoidance be- 
havior place great stress upon the conditioned aversive function of the 
warning stimulus Termination of the stimulus is generally held to provide 
reinforcement for the avoidance behavior, either directly (eg, Dinsmoor, 
1954, Schoenfeld, 1950, Skinner, 1953b) or through mediation of postulated 
drive reduction (eg, Miller, 1948, Mowrer, 1939) Such reinforcement 
would indicate that the stimulus itself becomes aversive [But see Mowrer, 
i960, p 50 ] It was, therefore, somewhat surprising to note the mability of 
the warning stimulus [used in this experiment] to maintain a higher rate of 
avoidance respondmg prior to its onset The present investigations aimed at 
a more detailed elucidation of the discriminative and aversive functions of 
warning stimuli in the avoidance situation (p 282) 

The Sidman-Boren experiment is intricate and, for anyone not inti- 
mately familiar with their theoretical presuppositions and somewhat 
cryptic vocabulary, perhaps also not entirely intelligible But under- 
standing and mastery of the details of their experiment is not, for our 
purposes, necessary The quoted passage serves, in any case, to show 
that questions are sometimes raised in this general area — and it also 
helps to sharpen an interesting paradox The results of the Akhtar 
studies indicate that orgamsms commonly seek out a place or assume 
a bodily orientation which permits them to receive a warning signal, 
thus suggesting that the signal has positive value or motivational sig- 
nificance for them, and yet, as Sidman & Boren cogently note, the gen- 
eral assumption, backed by much empirical research, is that warmng 
signals are “aversive,” le, fear-arousing and therefore disagreeable, 
objectionable, motivationally negative Fortunately, the Akhtar studies 
are of such a nature as to point to a solution of this problem Even in 
those rats which most systematically “sought” the warmng signal, it 
IS not in the least necessary for us to assume that this signal was posi- 
tive or rewarding, per se These animals were undoubtedly “pumshed” 
by the appearance of this signal and rewarded for making the responses 
that turned it off Why, then, did they “go for” it^ The answer, lit- 
erally, IS that they didn’t They did not seek the warmng signal as such, 
instead, they sought the situation in which the warning signal oc- 
curred, because (as we have already noted) they experienced less 
total fear here than in the no-signal situation Or, if this phraseology 
seems tainted with teleology, let it be said that for these ammals the 
no-signal situation, as a whole, was more fear-provoking than was 
the signal situation, and so the ammals experienced type-i secondary 
reinforcement of the responses that took them from the former to 
the latter and so developed a “habit ” 

However, to repeat, this is not to say that the signal as such was 
m any way “positive ” Actually what the signal does is to concentrate. 
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or ^‘collect,” all of the ammal’s fear m the one situation into one brief 
period and leave the rest of the intertrial interval relatively pleasant, 
whereas in the no-signal situation the entire intertrial period is fear- 
laden and, in balance, decidedly less attractive than the signal situa- 
tion Perhaps at no one instant, in the no-signal situation, is the sub- 
ject’s fear as high as it is, in the signal situation, when the signal comes 
on, but the total amount of fear experienced in, and therefore condi- 
tioned to, the no-signal situation will still be much greater than that 
experienced in and conditioned to the signal situation (by which is 
meant the situation in which the signal occurs but is not, for the most 
part, present) 

Epitomizing still further, one may say that no orgamsm likes to get 
a danger signal, but between two situations which involve danger, the 
one in which there is a signal will be preferable to the other 

In prompting this additional clarification of a really very mce theo- 
retical issue, the Sidman-Boren study, whatever its other ambiguities 
may be, is very useful 

X Perceptual Vigilance and Defense 

It could, of course, be argued that in the immediately preceding 
sections of this chapter we have been “talking around” the point at 
issue Thus far we have largely equated “perception” with “observing 
reactions^\ and it could be objected that what is really important is 
not what an organism does with his sense organs but rather what gets 
through to him, subjectively, in the form of sensations and “percepts ” 

Some years ago Bruner & Goodman (1947) reported that objects 
having positive value for the individual (e g , “com of the realm”) 
tend to be seen as physically larger than they actually are, and other 
investigators reported, at about the same time, that it is more difficult 
to see briefly exposed words with a “threatemng” meamng than words 
of neutral or positive connotation From these and similar observations 
(for reviews see Hilgard, 1951, Murphy & Solley, 1957, and Dulany, 
1955, 1957), the inference was drawn by some that perceptions are 
palpably influenced by our “wishes” and that we learn to “perceive 
as we wish to perceive ” But wishes, as we know, can diverge from 
leality, and the basic, biological function of perception (and sensory 
reception generally) is to tell us what is really there^ and not just 

“ This inference was undoubtedly prompted in part by the promises underlying 
the use of the so-called “projective” tests (cf Piotrowski, 1957), see also Hallowell 
(1950) on perception and culture theory 



198 LEARNING THEORY AND THE SYMBOLIC PROCESSES 

what we would like to believe (cf the emphasis of Gibson & Gibson 
on what they call “veridicality”) So it is not suiprismg that the result- 
ing literature has been a conflicted one, as regards both fact and inter- 
pretation (Postman & Crutchfield, 1952, Gardner, Holtzman, & Siegal, 
1956, Jenkins, 1957) 

If one attempts to go further in the study of “perception” than the 
mere observation of the way in which living organisms play their sense 
organs over the environment, and thus try to get at what the subject is 
experiencing subjectively, there is a great temptation to fall back upon 
verbal report This, of course, can be used only with human subjects, 
and, even here, there is a serious complication For example, who can 
say for certain that a college sophomore really did not “see” a tachisto- 
scopically presented obscene word or simply felt inhibited from re- 
porting (pronouncing) it? Although experimental techniques are now 
available which may be capable of handling this and some of the related 
difiiculties, we shall make no effort to review or evaluate them here, 
except as regards one special consideration which may be approached 
as follows 

During World War II, one of the writer’s students enlisted in the 
Navy and, after attending officer-training school, was commissioned 
and put in charge of a small coastal patrol craft In his first letter he 
described his and his crew’s assignment as that “of looking for sub- 
marines — and being scared to death that we’ll find one’” Their predic- 
ament, obviously, was much like that of the cardinals and the cat (Sec- 
tion VII), but in one respect it was more difficult If, in the course of 
Its observing responses, a cardinal found what it was “looking for,” 
It would undoubtedly have been momentarily dismayed, but then, by 
taking to flight, it could probably have quickly put itself safely out of 
range of the cat Although the particular look that led to the discovery 
of the cat would have thus been “pumshed,” the great majority of such 
responses would, as already noted, have been rewarded, and so might 
well be expected still to have considerable “habit stiength” when the 
bird’s hunger later brought it back to the feeding station Moreover, 
having thus seen the cat would have served to reinforce the bird’s fear 
and thus, indirectly, the observing responses, and the fact that even the 
one negatively reinforced observing response was shortly followed by 
escape from fear would presumably have tended, in some measure, to 
have offset the transitory negative reinforcement Thus we arrive at a 
plausible explanation, consistent with established reinforcement prin- 
ciples, of why vigilance responses may be perpetuated even though the 
“cue” be a negative one 
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By contrast, the members of the crew of the CP boat were con- 
fronted by a more serious situation if they found what they were 
“looking for,’’ honor and duty required that they approach and attack 
It Most of the time, as they scanned the horizon, the report came back, 
“Not there, not there,” with a reassuring effect which presumably re- 
warded and strengthened the observing action But now suppose that 
a submarine were sighted and attacked, with traumatic consequences 
The survivors of such experiences (if there are any) sometimes suffer, 
as we know, from “battle fatigue” and become unable to face further 
duty Here not only does the individual become incapable of again 
attacking the enemy — he cannot even look for or think about him 
And such an incapacitated individual may now unconsciously “defend” 
himself in any of various ways, including hysterical blindness, paraly- 
sis, hallucinations, and so on, but here we have clearly passed over into 
the realm of psychopathology, and the growing impression seems to 
be that “perceptual defense” results only in those circumstances which, 
as in the one cited, involve essentially insoluble conflicts (cf Stagner & 
Karwoski, 1952, pp 501-502) Normally, as we have seen, observing 
reactions are capable of being reinforced and perpetuated when the 
cue involved is negative, quite as well as when it is positive, and so, 
from the standpoint of ordinary principles and mechanisms, there 
seems to be no serious dilemma here We may reasonably doubt that, 
in a state of nature, living organisms are any more prone to perceive 
distortedly, because of motivational factors, than they are to stop 
making observing responses because such responses are sometimes pun- 
ishing Only, it seems, when an individual is “trapped,” with ordinary 
possibilities of escape cut off, is he likely to resort to reactions, either 
sensory or psychic, which cut him off from his environment Recently 
captured wild animals, unable to flee and hide from the world, may 
sometimes be seen “hiding the world,” 1 e , closing their eyes, standing 
with their face in a corner, putting their head under cover But this is 
an exceptional situation and, presumably, highly atypical behavior (cf 
Eriksen, 1958, pp 204-209) 

At the 1959 meeting of the American Psychological Association there 
was a symposium on “A Decade of ‘New Look’ Perception,” which 
admirably summarized the current status of the issues m this area 
Here Bruner remarked that “we now see better the great effective- 
ness of perception,” which m context seemed to imply an increasing 

“ Much the same logic might be expected to apply, also, as regards “repression ” 
Here, presumably, it is not a sensation that is defended against but an idea, a 
memory, an image (see Chapter 10) 
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recognition of the essential stabihty and accuracy of perception and 
Its relative immunity to the influences which were formerly em- 
phasized Perloe defended the concept of perceptual defense (as op- 
posed to the mere inhibition of report) But Eriksen took the position 
that in perception there are “two concurrent, parallel response sys- 
tems — the one affective, the other cognitive,” and added “I put the 
inhibition on the response level, not on the perceptual level ” Perceptual 
defense, he held, “is purely a response phenomenon, subject to ordinary 
principles of reward and punishment These effects are not really per- 
ceptual, they are exclusively response effects” (cf Dulany 8c Eriksen, 

1959) 

Here three trends are noteworthy 

1) A tapering off in the excitement about motivated modification 
of perception, which was so pronounced a decade ago 

2) Growing recognition of the essential stability (veridicality) of 
perception 

3) And recognition of the fact that perception (meaning) is both a 
cognitive and an affective phenomenon, in keeping with the basic as- 
sumptions of this chapter 

This field is obviously still somewhat unsettled, but there is no com- 
pelling factual evidence in it at present to contradict any of our major 
assumptions Attention, in the sense of sense-organ adjustment, is obvi- 
ously influenced by reinforcement factors, as are verbal reports m 
human beings (and behavior in general), but perception as sensation, 
and even as image, seems to follow the “reality principle” much more 
closely than they do the “pleasure piinciple ” 

XI A Note on Masochism and Compulsions 

It may not be at first apparent how “masochism” is related to the 
other topics discussed in this chapter Perhaps the phrase, “looking for 
trouble,” will suggest the connection From the standpoint of learning 
theory, such an expression implies a paradox which, at least as far as 
so-called perceptual vigilance is concerned, has been satisfactorily re- 
solved But what of the clinical concept of masochism^ Do we not here 
have a clear violation of Freud’s pleasure principle and of homeostatis 
in generaP 

While there may still be grounds for disagreement, there are grow- 
ing indications (Mowrer, 1938a, Whiteis, 1956) that masochism is more 
apparent than real As viewed climcally, it seems always to involve a 
situation where there is mounting anxiety or gmlt which can be re- 
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duced most effectively either by self-inflicted pain or by the individ- 
ual’s doing something that elicits punishment from others An experi- 
mental analogue of this situation is suggested in the following quota- 
tion 

In an analysis of the learning process as exemplified in conditioning, 
which has appeared elsewhere (Mowrer, 1938a), the writer has posited (on, 
the basis of the spontaneous comments of subjects used m an mvestigation 
of the galvanic skin reaction to electric shock) that if a stimulus is pre- 
sented recurrently, at regular temporal intervals, expectation of that stim- 
ulus rises and falls in the manner indicated in the schematic diagram repro- 
duced [in Fig 5-4] The assumption that was made at the time of the 
original publication of this diagram, but not incorporated m it, was that if 
a stimulus does not occur at the expected point, expectancy may remain 
constant for a time, or perhaps even mount a little higher than usual, and 
then undergo a relatively gradual decay (Mowrer, 1940, p 5) 


Expectancy 

Stimulus 



Fig 5-4 Schematic indication of the way in which “expectancy” (eg, fear) will 
rise and drop as a function of the recurrent presentation of a “stimulus” (eg, 
momentary electric shock) (Reproduced from Mowrer, 1938, p 72 ) 

In the example cited (which has been empirically confirmed), 
we see that under some conditions pain (or punishment) can indeed 
have the effect of reducing rather than arousing fear, and this fact 
has prompted laboratory workers occasionally to see if the subject can 
be induced to give himself the “shock” (or other form of painful stim- 
ulation) which is needed to reduce the fear However, with one ex- 
ception — ^the experiment of Whiteis, cited m Chapter 12 of Learning 
Theory and Behavior — none of these efforts has succeeded a human 
being (or other living orgamsm) apparently will not “hit himself on 
the head with a hammer because it feels so good when you stop ” Ordi- 
narily there must be a source of guilt or anxiety outside the immediate 
situation to “prime” masochistic behavior (Dulany & Tsushima, 1959) 
Thus an individual may seek one form of pumshment as a sort of sub- 

^^This, of course, is because the shock has acquired, in addition to its inherent 
negative reinforcing properties, the capacity to act as a sig ^ — a sign that a period 
of no-shock is to follow Cf the discussion (Mowrer, i960. Chapter 12) of the 
sign value of food or its absence m situations where the subject is hunger-motivated 
See also Baker (1959) 
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stitute for another, more serious form and use it as a form of ‘^sympto- 
matic relief,” in an effort, apparently, to avert the latter (see, for ex- 
ample, Wischner’s analysis of stuttering, 1952) But in this and all the 
other instances cited in this chapter which superficially seem to violate 
the homeostatic principle, we find that, upon closer examination, the 
violation IS more apparent than real At least, as of the present writing, 
there is no known compelling example of pure “pleasure in pain”, 
and in Chapter 10 we shall see that even in those instances where moral 
principle prevents an individual from taking the easy road of pleasure 
or sloth, there are still ample grounds for interpreting such behavior 
within the homeostatic framework 

Originally this section dealt only with masochism, but Mr Jerry 
Griffith (a graduate student in the Department of Speech at the Uni- 
versity of Illinois) has made a suggestion which invites some additional 
comment As a result of reading this chapter (in proof), Mr Griffith 
reported that the cyclic, repetitive behavior involved in observing 
reactions reminded him (and he cited particularly the case of the 
hungry cardinals and the cat) of “compulsions” as seen climcally, 
which are also repetitive and cyclic m nature For reasons which will 
be elaborated in Chapter 10, it is not a major objective of this book 
to make climcal application of the principles which are here under 
discussion, but it will do no harm, at least in passing, to look at such 
a classical compulsion as Lady Macbeth’s recurrent hand washing and 
ask wherein it resembles or differs from the recurrent “looking” of 
the cardinals 

One might be tempted to say that the looking “accomplished some- 
thing,” whereas the hand washing did not But this is not a very pene- 

“ It goes without saying that a mild shock can be made to acquire secondary- 
reinforcement capacity Experiments carried out in Pavlov’s laboratory by 
Erofeeva show that an electrical shock (if introduced at a low intensity and 
gradually increased) can serve as a conditioned stimulus for salivation in very 
hungry dogs (Pavlov, 1927), and from this one would infer that the shock, m 
the process of its association with food, had also acquired secondary-reinforcement 
power If given an opportunity, the subjects in this experiment would presumably 
have performed some act as a means of “getting” this stimulus, even though it was 
now not followed by food An observer who saw a dog thus shocking himself 
and who did not know the learning that had preceded such a performance might 
well be tempted to make a diagnosis of “masochism ” But if our general analysis 
of secondary reinforcement is correct, the sounder view would be that the bops 
generated by the shock in a situation of this kind would (at least for a few trials — 
perhaps a great many if an intermittent-reinforcement training procedure had 
been used) be sufficiently rewarding to more than offset the negative effect of 
the shock itself 
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trating distinction, for if our principles are valid, the hand washing, 
if 7iot in some sense functional, would have soon extinguished In 
other words, we do not believe in “habits” as purely automatic actions 
which, once started, continue without motivation or reward The 
compulsive hand washing must accomplish something, we would as- 
sume, in order for it to persist Nearer to the heart of the matter 
perhaps is whether what it accomplished was or was not obvious 
The birds were presumably looking to see if the cat was “there,” and 
the looking served this function very mcely — ^and presumably no other 
But in periodically washing her hands, was Lady Alacbeth really wash- 
ing them or doing something else^ Adamfestly, she could not be moti- 
vated by the fact that her hands were dirty in any ordinary sense of 
the term, so we say the function was in some way symbolic, or symp- 
tomatic The washing of her hands presumably acted as a sort of token 
confession and expiation, which gave momentary but not enduring 
relief, for it did not alter the fact that she stood guilty of having par- 
ticipated in the treacherous murder of the king 

Thus, the mam similarity between Lady Macbeth and the cardinals 
is that in order to remain tolerably comfortable and “secure” they both 
had to “keep doing” something, which may be termed a phenotypic 
resemblance But genotypically, le, in terms of genesis, the actions 
were very different, the one realistic, frank, just what it seemed to be, 
the other devious, distorted, symptomatic Many behaviors are, of 
course, repetitive — m fact, repetitiveness is one of the hallmarks of 
“habit ” But not all habits are “compulsive ” The point of the differ- 
ence is that the motivation and reinforcement which keep “normal” 
habits going are clear and recognizable The more obscure they are 
(to others and perhaps to the actor himself), the more likely we are to 
say that the resultant behavior is “compulsive,” rather than merely 
“habitual ” 

And much the same distinction, incidentally, can be made between 
an “obsession” and normal thought, which will be our topic for con- 
sideration in the next chapter 

Xn Images, Phase Sequences, and Cognitive Dissonance 

Once the concept of imagery has been admitted into systematic 
behavior theory, its implications ramify in profusion in many direc- 
tions, as the preceding sections of this chapter attest So at this point 
It would not be unnatural if the reader viushed for a nice, tidy summary 
statement This, at least from the present writer, is not possible In- 
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stead, we shall only complicate the picture further by exploring other 
facets of the problem — and we shall investigate still others in later 
chapters The precise mapping of this territory can come at another 
time Just now we have to establish major landmarks and general 
terrain 

Everyone has piobably had the experience of being, as we say, lost 
in reverie and then finding that it takes a moment, and perhaps a little 
effort, to “come back to reality ” A graduate student in psychology 
once reported that as an undergraduate he sometimes would day-dream 
in class and then have the experience of the instructor’s voice “gradu- 
ally getting louder again as the daydream or fantasy passed” This 
phenomenon reminded him, he said, of current work on the reticular 
formation which shows that as an organism concentiates on stimuli 
in one sensory modality, there is often a blanking-out of impulses 
from other modalities (Hernandez-Peon, 1956, Lindsley, 1957, Sut- 
ton et al, 1959) Therefore, it seems entirely possible that vivid im- 
agery can likewise “suppress” the centers concerned with actual sensory 
imput 

Several years ago a young woman who had become alarmed about 
her sanity consulted the writer because she found that what had origi- 
nally been deliberate day-dreaming was getting out of control, with 
some difficulty on her part at times in telling what was real and what 
was not And in psychopathology in general the problem is a common 
one, termed hallucination This phenomenon, in simplest form, is sim- 
ple indeed and hinges upon the question of how sensations and images 
can be reliably differentiated Half a century ago, Titchener, in his 
Textbook of Psychology (1909b), went at the problem in this way 

The facts of synaesthesia lead up to the question of the nature of the 
image, and of its differences from sensation It is usually said that the image 
differs from the corresponding sensation in three respects its qualities are 
relatively pale, faded, washed out, misty, and its intensity and duration are 
markedly less [cf Section I] 

Since these differences are all differences of degree, and not of kind, it 
should be possible to find experimental conditions under which the sensation 
and the image are confused Experiments have, in fact, been made, and with 
positive result, m the fields of sight, sound and touch (pp 197-198) 

Experiments are then described in which images are sometimes taken 
to be sensations and sensation to be images, after which Titchener 
continues 

How is It, then, that we so rarely confuse image with sensation in our 
everyday existence^ Well, the confusion may not be so uncommon as we 
suppose However, if it is, the distinction may be accounted for, at any 
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rate in large measure, by the differences of conscious context or setting in 
w hich the two processes appear Images, for instance, seem to be less sharply 
localized than sensations, they change and shift more rapidly, and in a mean- 
ingless way, they move with movements of the eyes 

Individual minds differ widely in the nature and frequency of their char- 
acteristic image-processes (pp 199-200) 

As Titchenei then pioceeds to show, visual and auditory im- 
ageiy are common, kinesthetic and tactile imagery less so “Images 
of taste and smell have been reported, but only exceptionally play 
any considerable part in consciousness Organic images are rare” 
(p 200) 

If, per hypothesis, images are a conditioned version of sensations, it 
need not surprise us that there is often striking similarity between 
them, and if imagery is to do its work effectively, we must obviously 
be capable (Section III) of generalization from one to the other 
McKellar (1957) has recently reviewed the sizeable, and growing, 
literature on imagination and thinking in a book with this title (see also 
Barber, 1959, and Nash, 1955), and we shall have occasion in ensuing 
chapters to examine the so-called representational function of images 
Here, however, we shall largely limit ourselves to the phenomena 
specifically mentioned in the title of this section Fortunately, Hunt 
(i960) has reviewed the pertinent literature in this connection, and 
we can rely heavily upon his exposition He says 

Hebb’s (1949) theorizing is physiological in that he conceives the residues 
of past inputs to be stored in semi-autonomous, reverberating cerebral cir- 
cuits which he terms cells assemblies These cell assemblies are the neural 
analogue of concepts, and they get sequentially integrated into what he calls 
phase sequences The sequential organization m time provides for the sub- 
]ective phenomenon of expectation When markedly mcongruous receptor 
inputs disrupt this sequential organization, behavior is changed and the 
process is felt as unpleasant emotion Slight degrees of incongruity, which 
can readily be accommodated, lend interest and may provide attractive 
problems, but the larger ones are repelling and perhaps even devastating 

(pp 22-23) 

Hebb’s particular phraseology is not an attractive, or particularly 
intelligible one, to the present writer (and the notion of reverberating 
circuits as the basis of memory is almost certainly wrong, factually), 
but the import of Hunt’s last remarks is clear One is sitting at his 
office desk typing There is a door to his right and slightly forward 
From hundreds of past experiences, this person has the expectation 
that if he opens this door, he will see a hallway, stairs, etc Suppose, 
now, that upon opening the door, this person sees Lake Michigan^ If 
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such a thing happened, it w ould indeed be “devastating ” And ex- 
periences of this kind occur frequently in psychosis Commonly termed 
disorders of thought or hallucinations and attributed to some bio- 
chemical disbalance, might not such phenomena instead represent a 
form of self-punishment, even more exquisite than depression whose 
retributor\ function can hardly be missed^ Take the case of the 
schizoid girl lef erred to a few paragraphs eailier Suppose that her 
daydreams w ere of a guilt-mducmg nature (as they indeed were of an 
affair, thinly disguised as physical examinations, with a middle-aged 
physician) If conscience could not control this behavior with the 
affect of depression (or anxiety), is it inconceivable that it might try 
to do so “cognitively,” by disrupting normal “phase-sequences” or 
“expectations”? The upshot of this joung w^oman’s seeking “help” was 
that she abandoned the fantasied sexual gratification (or “mental mas- 
turbation”), and secured a divorce from a joyless marriage, and in a 
few months remarried, successfully Was the “unconscious” disruption 
of established “phase-sequences” a mark of “deep pathology” in this 
girl, or of profound health and strength? But we are digressing Hunt 
continues 

Jean Piaget (1952b, 1954) utilizes \ery much the incongruity notion to 
account for the development of intelligence and concepts in human chil- 
dren 

Helson (1947, 1948) has called the residues of immediate past experience 
in the typical psychophysical expenment an adaptation level Both he and 
McClelland (1953) have seen affective arousal to be a matter of the size of 
the discrepancy between receptor imputs and the adaptation level Small 
discrepancies may be attractively pleasant, large ones repellingly unpleasant 
Some of you will readily recall havmg experienced the affective startle that 
comes when you have been set to pick up what you thought was a full pail, 
only to find it empty 

Leon Festinger (1957) has recently written a book entitled A Theory of 
Cognitive Dissonance in which he shows that a discrepancy between belief 
about a situation and perception of that situation acts like a drive The sub- 
ject acts to reduce the dissonance by either withdrawing from the mcredible 
situation or by changmg his beliefs, and, incidentally, finding the dissonance 
highly unpleasant 

Manifestly, the situation is this In normal “phase-sequences,” each familiar 
sensation arouses an image, or expectation, of what is to come next And such 
expectaaons are ordinarily confirmed, 1 e , the ensuing sensation is congruent with 
the image aroused by the just preceding sensation When sensation does not 
match image or expectation, there is obviously surprise, not to say dismay We 
have talked much, in recent decades, about the anacipatory or expectancy func- 
tion of emotions (especially fear) Hebb has done us a service in calling attention 
also to the essentially expectant nature of many cognitions 
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Carl Rogers (1951) has described the basis for anxiety as discrepancy be- 
tween the phenomenological field and perceived reality 

George Kelly’s (1955) Psychology of Personal Constructs refers to the 
ways in which individuals construe and anticipate events 

Perhaps it is worth noting that this incongruity-dissonance principle 
makes both motivation and reinforcement intrinsic to the organism’s rela- 
tion with Its environment, intrinsic, if you will, to the organism’s informa- 
tion-processing It IS as if the organism operated like an error-actuated, 
feedback system where the error is derived from discepancy between re- 
ceptor-inputs of the present and the residues of past experience which serve 
as the basis for anticipating the future The dominant view of the past half 
century has seen both motivation and reinforcement as extrinsic to in- 
formation processing (pp 23-25) 

Obviously there is much ferment in this field at the present time 
The next two chapters rest directly upon the groundwork laid in the 
present one 

After this book was m page proof, an extraordinarily pertinent paper came 
to the author’s attention Written by Staats, Staats, & Heard (i960) and entitled 
“Language Conditioning of Denotative Meaning,” it provides direct empirical 
confirmation of a number of assumptions made in this chapter (see especially 
Sections I and II) Similarly persuaded that there is more to word meanmgs than 
mere emotion (evaluation, connotation), these authors ha\e been able to show 
“that what is commonly called denotative meaning may be conditioned to non- 
sense syllables to form their meanmg Moreover, the principles of denotative 
[cognitive] meaning conditioning appear to be the same as those in\ol\ed in the 
conditioning of connotative meanings” (p 10) And later they add “Thus, if 
the term ‘denotative meaning’ is to be used, it is suggested that it refer to the 
implicit, mediational, representational responses which can be classically con- 
ditioned to words, as were the responses in the above studies The unconditioned 
stimuh used in the two studies were sensory sumuli and the implicit responses 
involved would presumably be elicited on the basis of the sensory characteristics 
of the stimuli” (p 12) “In a recent article Staats (1959b) proposed that one type 
of representational mediating response which can be conditioned to words to 
form their meanings may consist of sensory responses originally elicited by a 
stimulus object These conditionable sensory responses [le, sensations which, 
when conditioned, become images] could be visual, auditory, or tactual responses, 
1 e , components of the ‘seeing,’ ‘hearing,’ and ‘feelmg’ sensory responses elicited by 
the appropriate stimulus A number of studies (eg, Leuba, 1940, Phillips, 1958, 
Lipton & Blanton, 1958, and studies of sensory preconditioning) indicate that 
sensory responses may be conditioned, and two of them (Phillips and Lipton & 
Blanton) indicate that these responses may constitute the meanings of words” 
(p 12) There are many other passages in this important paper which further in- 
dicate the marked congruence between the authors’ findings and the general 
theoretical position here adopted 



Learnings Thought^ and Insight 


Structuralism, or so-called Faculty Psychology, compartmentalized 
mind into thought, feeling, and action In Learning Theory and Behavior 
It has been shown that the modern conception of learning umfies and 
fuses feeling and action into an organic whole, and in the immediately 
preceding chapters, the concept of “action,” or response, has been 
broadened to include mediators and images Now we turn to a consid- 
eration of that special form of exploratory and aiiticipatory action 
known as “thought,” which also, like action in general, is found to be 
intimately related — not opposed — to feeling Thus will we achieve a 
still more integrated conception of the functioning of the “total organ- 
ism,” which will then provide the basis for a discussion, in the follow- 
ing chapter, of that ever emgmatic but manifestly important topic, 
consciousness 

But first a disclaimer the present chapter m no sense purports to 
give a complete account of the psychology of thought (see Flavell & 
Draguns, 1957, and Bartlett, 1958) It is merely an approach to the sub- 
ject, from the particular vantage point provided by our general sys- 
tematic position Wlule avowedly incomplete, this approach may. 
however, have the virtue of suggesting new experimental problems 
and fresh theoretical perspectives 

I The 'Thoughtlessness^^ of Behavioristic 

Theories of Learning 

As noted in several earlier chapters, behavioristic conceptions oi 
learmng were commonly presented in such a way as to make the 
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organism itself appear unimportant In both response substitution 
(trial-and-error learning) and stimulus substitution (conditioning), 
S— R bonds were drawn straight “through” the orgamsm, without so 
much as bothering to note the orgamsm’s existence, however inciden- 
tally, with an interpolated “O ” This, of course, was no mere inad- 
vertence The aim was to have an entiiely objective psychology, a true 
science of behavior^ which would not be plagued by any subjective 
agencies or activities 

The central idea of behaviourism was that all animal and human behaviour 
should be studied only empirically and that any reference to what the animal 
thinks or feels is superfluous (Konorski, 1958, p 1 106, see also Troland, 1928, 
and Pillsbury, 1950) 

In all seriousness, thought could not, of course, be entirely disre- 
garded, and Watson made a gesture in the direction of acknowledging 
it as a form of sub vocal speech Osgood (1953) has neatly put the mat- 
ter thus 

It was Watson, in Behavior An Introduction to Comparative Psychology 
(1914), who first made a comprehensive defense of the thesis that thoughts, 
ideas, and images are merely implicit verbal responses As the most vigorous 
sponsor of a nascent behaviorism, he was crusading agamst mentalism m 
psychology, and such concepts as “thought” and “image” are certainly mental- 
istic m connotation This materialistic position was not original with Watson, 
many thmkers before him had stated its essence Bam, for example, had 
said, “Thinkmg is restrained speakmg and actmg ” But Watson’s statements 
were made at a time when experimental psychology was taking root, and 
the proposition — thought is implicit speech — ^was an open mvitation to the 
gadgeteer (p 648) 

Osgood then reviews various experiments which were instigated by 
the implicit-speech theory of thought, experiments which, while in- 
gemous, led to somewhat uncertain results Fortunately, the issue does 
not hinge entirely upon the results of such research, for there is a logi- 
cal issue which is in many ways more compelling It is agreed that am- 
mals other than man do not have speech, and if it is then further agreed 
that thought is implicit speech, it follows that no animal other thaji 
man thinks Descartes had, of course, long before been forced into a 
somewhat similar dilemma (see Chapter 10), and it was no less awkward 
for the Behaviorist 

Clear evidence for “thought” in animals will be obtamed in situations in 
which the relevant cues are not available in the external environment at the 
time the correct response is required^ but must be supplied by the organism 
itself Several situations that meet this criterion have been devised and ex- 
tensively studied Two of the earliest animal experimentalists, Lloyd Mor- 
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gan (1900) and Thorndike (1911), did conclude that animals are incapa- 
ble of higher mental processes, ha\e no ideas or thoughts as such More 
recent investigators have refuted this position, yet — and this is an interesting 
bo\^ to the classic tradition— they have cautiously referred to “representa- 
tional factors” rather than to “thought” when describing symbolic processes 
in animal subjects (Osgood, 1953, p 656) 

In the same year that Osgood’s book appeared, the then president of 
the Canadian Psychological Association opened an address to that or- 
ganization, entitled, “On Human Thought,” with the following remarks 

In the topic of human thought I have chosen what is indubitably the 
central problem of psychology — at once the most difficult and the most 
important that scienasts face Its difficulty is the burden of my address, 
as for Its importance, this can be seen both in the technical field of research 
and in the practical world of affairs 

Thorndike tried to dispose of the difficulty fifty-five years ago by deny- 
ing Its existence He buried thought in 1898, but the ghost insists on walkmg 
Often we decline to say that animals think, but comparative psychology 
has been unable to avoid concluding that animals have expectancies, in- 
sights, hypotheses, conceptual activities, a variable attention, and so forth 
These are but aspects of thought, and if we cannot deal with the compara- 
tively simple beha'vior of animals without taking account of thought, how 
adequate can a thought-less human psychology be^ (Hebb, 1953, p 99) 

It IS not difficult to see why Thorndike should have tried, as Hebb 
puts It, to “bury” thought The mam business of thought, surely, is to 
guide and control action, to make it intelligent, adaptive, efficient, pre- 
cise Thorndike’s Law of Effect proposed an alternative means of 
achieving the same end Effects, le, rewards and pumshments, were 
seen as stamping actions “in” or “out,” and thus selectively, intelli- 
gently, adaptively determining behavior The effects of a given action 
thus altered, redirected, controlled subsequent conduct and left no 
place or need for “thought” or “intellect ” 

As V ill be recalled from the beginning chapters of Learning Theory 
and Behavioij Pavlov’s formulations, though different in principle from 
those of Thorndike, were similar in goal Pavlov was likewise inter- 
ested, not just in a theory of “learmng,” but in the organism’s total 
behavior, m what Hull was later to refer to as the principles of adap- 
tive action Both trial-and-error learning and conditiomng imply adap- 
tation to the environment, but this end was achieved, m both cases, 
“mechamcally,” nonmentalistically, voithout thought 

Two-factor learning theory, m its second version, accepted Thorn- 
dike’s theory of habit formation, essentially unmodified, and, m doing 
so, necessarily ahgned itself with the thoughtless psychologies, or “be- 
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regulatory process Is the concept of thought incompatible with that 
of determinism- Not at all — ^it is simply a question of the complexity, 
and flexibility, of the determimsm 

In the next section we shall make at least a preliminary attempt to 
indicate what thinking, as opposed to learning, is 

II Vicarious Trial and Error as "Overt Thinking" 

If It IS not already evident from common observation, reviews by 
Johnson (1950) and by Taylor & McNemar (1955) show unmistak- 
ably that the terms, “thought” and “thinking,” are used, at the human 
level, to refer to a wide variety of “higher mental processes” which 
ha\ e long defied exact analysis However, a promising lead to the field 
as a w’hole is provided by a bit of behavior which, being behavior, is 
objectively observable but which is also typical of “thought ” 

In an experiment reported in 1931 under the title, “Tone Discrimina- 
tion in White Rats,” Muenzinger & Gentry observed a type of activity 
in their subjects which, though noted before, had not previously been 
given much attention Writing in 1946, Muenzinger says of the earlier 
study 

Several years [ago] Dr Evelyn Gentry and I studied the auditory sen- 
siuvity of the white rat In doing so we made a special effort to record 
mmutely the behavior of each animal at the point of choice A rat would 
stop before entering either one of the choice alleys and turn his head to the 
left and right, often several times in succession The frequency per trial of 
this type of behavior increased as the animal was nearing the phase of per- 
fecting his habit, and it disappeared as soon as the habit was automatized 
Since this turning of the head seemed to replace the actual entry into the 
V)rong alley, we named it “vicarious trial and error,” or VTE I shall not 
be able to tell you all of this fascmatmg story of the exploration of what 
appears to be a primitive kind of thinking (p 12, italics added) 

From what has been said thus far, it may seem a trifle forced to refer 
to the slow, lateral head “wagging” here described as a form of “think- 
ing” Would It not be simpler and generally more defensible merely 
to say that the rat, in “looking” (or Iistemng) now to the right, now 
to the left, is trying to decide which of two stimulus specimens, or 
cues, IS the correct one, 1 e , which indicates an open route (on any 
given trial) to the goal and which indicates a closed route and no 
reward? But at once we see that something more must be involved 
here The cue stimuli (tones, colors, visual patterns, or whatever) have 
cue properties only by virtue of prior learmng, 1 e , the fact that, on 
past trials, one has been followed by food and the other by no food 
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(and frustration), and have in this way acquired distinctive meanings 
So V'hat the subject is really doing is comparing the tijjo diffeient in- 
ternal {conditioned) reactions which the cue stimuli arouse Hence the 
comparison that really counts is the one being made beween two in- 
ternal ('‘mental”) states, and the playing of the distance receptors 
(ears, eyes, etc ) back and forth is merely the necessaiy means of 
arousing these inner states, successively (see Chapter 5) 

All this can be made clearer still by examining the VTE that occurs 
m a somewhat different type of situation In so-called discrimination 
experiments with animals (such as performed by Muenzmger & 
Gentry), there are always two (or more) external stimuli or signs 
which “lead to” different consequences However, as previously noted 
(Mowrer, i960, Chapter 12), these stimuli “move around” from trial 
to trial, so that the correct “response” does not involve either making 
a particular set of movements or going to a particular place {op cit , 
Chapter 8) Instead it involves learning to go toward one stimulus (no 
matter where it is or what movements have to be made to get there) 
and away from another stimulus {op cit , Chapter 9) 

Let us now consider what is in some ways a simpler, and more in- 
structive, situation Suppose that the task set a rat is that of learning 
to go to the right at the choice point in a T-maze That is to say, food 
will always be found in the goal box at the end of the right wing, never 
in the left wing, so that the animal is learning both to go to a particular 
place and to do so by means of a particular response But now, unlike 
the usual “discrimination” set-up, there are no external “cues” The 
right and left wings of the maze look, sound, smell, and feel as nearly 
alike to the rat as human ingenuity can ensure, and, what is more, all 
so-called “extra maze” cues will be strictly balanced and equated Yet 
the ammal still has to “decide” which way to turn when it gets to the 
choice point With no objective cues available, this might logically 
seem hke a difficult thing to do Yet, intuitively, we know that the rat 
will have no more — ^in fact, probably less — trouble here than in the 
“discrimination” situation 

Careful observation of the actual performance of a rat in a learning 
situation of the kind just described reveals a remarkable fact the rat 
will make VTE movements, even though there is absolutely no differ- 
ence in what he sees, hears, or smells in either direction^ Nevertheless, 
one has the impression that the subject is making some sort of discrimi- 
nation, some sort of comparison What could it be^^ Then we recall 
that, on each preceding trial, turning right has been followed by one 
result (reward) and that turning left has been followed by a different 
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result (no reward) Therefore the 'tesponse-produced stimidi associated 
with these two different consequences (decremental versus incremental 
reinforcement) become conditioned, respectively, to hope and fear 
Thus, when the rat “turns right” or “turns left” in mimature, as it does 
in VTE, It is, so to say, “sampling” the consequences which will fol- 
low if It actually turns one way or the other The rat, in moving its 
head back and forth, is thus engaging in a very simple but real type of 
“reasomng” — ^it is, quite literally, “using its head ” ^ 

Now wherein does the experimental situation just described differ 
from the so-called discrimination apparatus or situation? Obviously, if 
our surmises be correct, the rat is making a “discrimination” in the 
T-maze no less than in the other situation, and in both instances the 
discrimination is betAveen the anticipated consequences of one course 
of action as opposed to another The difference, rather clearly, is that 
in the one case differential cue stimuli are provided by the environ- 
ment, whereas in the other case the subject has to make them himself 


ill. VTE, Further Evidence and Theory 

In one of his earliest theoretical papers, Hull (1930b) displayed an 
excellent grasp of the foregoing problem and coined an apt phrase — 
“pure-stimulus acts” — to refer to those responses which an organism 
makes solely for the purpose of providing itself with much needed 
cues But because Hull’s theory as he later developed it was, like 
Thorndike’s, basically behavioristic, basically thought-/crr, Hull made 
little systematic use of the pure-stimulus-act notion Says Osgood 

(1953) 

In the Hull paper already cited we find the following “A reflective con- 
sideration of the habit mechanisms mvolved in anticipatory defense reac- 
tions reveals a phenomenon of the greatest significance This is the existence 
of acts whose sole function is to serve as stimuli for other acts We shall 
accordingly call them pure stimulus acts'^ (p 515) And m the summary of 
this paper Hull declares “Such behavior sequences have great biological 
significance because they enable the organism to react both to the not-here 
and the not-now Incidentally it accounts for a great deal of the spontaneity 
manifested by organisms The concept of the pure stimulus act appears to 
be the organic basis of symbolism ” (p 524) For a number of reasons, 

^ Freud (1911) has likened thought to a general moving lead soldiers about on 
a miniature batde field, m preparauon for a real battle to follow And Osgood 
(1953) has spoken of thought involving “light” (le, easy and safe) responses 
which help the individual determine what course of overt (“heavy,” important, 
fateful) action to pursue 
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chiefly the extensiveness of the research program he set for himself, Hull 
never did fully explore the implications of this mechanism (pp 395-396) 

The perceptiveness of Hull’s analysis is rendered all the more re- 
markable because it came before the careful empirical work of Muen- 
zinger and his students However, the phenomenon of VTE, though 
not so named, has long been famihar to animal experimenters, and the 
interest and research work it has more recently generated is indicated 
in the opemng paragraphs, quoted below, from the very competent 
and complete recent survey, “Vicarious Trial and Error and Related 
Behavior,” by Goss & Wischner (1956) 

A number of experimenters have reported a more or less typical and fre- 
quent pattern of behavior which occurs at the point of choice m the dis- 
crimmation box, maze, or durmg the choice process m visual discrimmation 
studies employmg jumping stands This pattern has been variously de- 
scribed as “choice by negation or comparison,” “lookmg to the right or 
left before choice,” “swaymg back and forth,” “head movements,” “partial 
elimmation,” etc To this general pattern of behavior Muenzmger and 
Fletcher (1936) have given the name “vicarious trial and error,” abbreviated 
“VTE ” 

Although first used to label choice-pomt behavior of rats prior to spatial 
or non-spanal discriminative responses, the term VTE has subsequently 
been extended to vacillatory behavior m conditioning (Girden, 1938), rea- 
sonmg (Maier, 1940), place vs response learning (Ritchie, 1947, Rutchie, 
Hay & Hare, 1951, Tolman & Gleitman, 1949a, Tolman, Ritchie, & Kalish, 
1947), delayed reaction (McCord, 1939b), conflict (Barker, 1942), and 
even non-choice (Taylor & Reichlin, 1951) situations Moreover, not only 
the choice-pomt or choosmg behavior of rats but also of dogs (Girden, 
1938), monkeys (Kluver, 1933), children (Barker, 1942, Gellerman, 1933a, 
1933b), and adults (Tolman, 1941) m various of these situations has been 
labeled “VTEmg ” Thus VTE behavior now refers to the vacillatory be- 
havior of various types of Ss at points of choice m a wide range of situa- 
tions 

On the theoretical level, VTE has been mterpreted as a behavioral defi- 
nition of consciousness (Tolman, 1926, 1927, 1932), a catalytic process 
which aids learning (Tolman, 1938, 1939, 1941, 1948), a form of symbolic 
exploration (Mowrer & Ullman, 1945), an analogue or mechanism of rea- 
soning (Maier, 1938, Muenzmger, 1938), “overt thinkmg” (Dashiell, 1949), 
a behavioral index of conflict (Barker, 1942, Brown, 1942, Hovland & 
Sears, 1938, Miller, 1944, Sears & Hovland, 1941, Underwood, 1949), or a 
preparatory response (Taylor ScReichlm, 1951) Tolman (1938, 1939, 1941), 
particularly, and Barker (1942), Schlosberg and Solomon (1943), Taylor 
and Reichlin (1951), and Austm (1953) have advanced relatively complex 
and systematic explanations of the VTE phenomenon (p 35) 

That the phenomenon of VTE should have had a special interest 
and attraction for Tolman and his students is almost axiomatic He 
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has long held that \\ hat is learned are expectancies, ?iot performances, 
and that theie are important “intervemng variables” or processes be- 
tw een “stimulus” and “response ” In VTE we seem to see such mter- 
\cning processes clearly at work That the rat should engage in some 
degree of reasoning or thought at a choice point, whether in a maze 
or on a discrimination stand, is certainly consistent with Tolman’s 
whole approach But, as Guthrie (1952) has obseived, we must be 
careful not to leave the rat at the choice point ‘‘‘‘lost in thought ” We 
must somehow get him “going” again, and eventually to his goal If, 
in thought, we are merely deahng with expectancies in the sense of 
“pure cognitions,” there is an acute problem here But if, instead, we 
view these expectancies more dynamically (as hopes and fears), then 
we have a basis for expecting thought to be closely related to, and to 
eventuate in, overt motion As the rat symbolically samples, succes- 
sively, the probable consequences of one course of action as opposed 
to another, he is not experiencing mere cognitions but actual motivating 
states, with reinforcing properties, and we may plausibly conjecture 
that what happens is something like this Each turn of the head to the 
right produces, let us say, a little feeling of hope, while a turn to the 
left produces slight fear The head responses are repeated a few times 
more, with their attendant experiences, and presently, as a result of 
“on-the-spof^ conditioning, turning head to the left, even in token 
form, becomes disagreeable, while turning the head to the right is 
pleasant The rat is now “all set” (Tolman w^ould say “cogmtively 
structured”), and all he can do is to “follow his nose ” ^ 

Perhaps the difficulty inherent m Tolman’s analysis arises from a 
false antithesis which has long been made (at least since classical 
Grecian times) between z?itellect and emotiozi Emotion has been re- 
garded as a low order of acnvity, to be distrusted and shunned, whereas 
intellectual processes are said to occur on a higher order and to be 
more worthy of cultivation Hence, if this antithesis is accepted, one 
would be inchned toward a “purely cogmtive” rather than affective 
analysis of thinking 

That there is reason to distrust this antithesis is now evident on 
many sides, but McGill (1954), in a recent book on Emotions and 
Reasozi, puts the matter especially well when he says 

® Parenthetically, one might say that the purpose (function) of thought is to 
end thought It helps one to decide, to "make up one’s mind,” to stop thinking 
and act One thinks when m doubt, thought (reasoning) is a means of resolving 
doubt, gaimng certainty (cf Bartlett, 1958) 
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It was Plato in the Phaedrus, who first gave expression to this dualism of 
emotion and reason Reason is depicted as a noble steed “straight and well- 
knit, with high neck and arched nose, in color white, with black eyes, a 
lover of honor m all temperance and modesty, a friend of true glory, ” 
whereas desire, or emotion, is a horse of a different color — “crooked, lump- 
ish, ill-jomted, with a stiff neck, a short throat, a stub nose, in color black, 
with gray eyes, sangumeous, a friend of lust and boastfulness, ” Whereas 
the noble white horse follows the path of truth, goodness and beauty of its 
own bent, the bad black horse of desire is perverse and impetuous, strivmg 
might and mam to drag the white horse and the charioteer down some dark 
road where destruction is certam, and must be contmually chastised and 
corrected 

Those who divorce emotion and reason have sometimes forgotten that 
this is only a myth, and that Plato himself, as m Phtlebus, presents quite a 
different picture There, emotion is the complement of reason and falls 
mto error only when true knowledge fails Aristotle also saw that emotion 
and reason are not opposites but mtegral parts of one process and m- 
separably associated m the good hfe, or happmess Emotions are to be 
restramed m some cases, but strengthened and cultivated m others Spinoza 
showed, even more clearly, that emotions mvolve reason and reason, emo- 
tions, and that the narrowness and stupidity of the passions is also a priva- 
tion and confusion of knowledge The evd of the passions is to be cured 
only by summonmg other emotions which are contrary to them (p viu) 

In summary, then, we may say that the simplest and clearest instance 
we have of “thought” in animals suggests that this phenomenon, rather 
than being unrelated to emotions and motives and remforcers, is asso- 
ciated with them very intimately Emotions are, m fact, the core of 
thought in that they mediate between primary drives and the real con- 
sequences of various possible actions In VTE, as exhibited by rats and 
certain other ammals, what the organism tries to do, apparently, is to 
sense and compare two (or more) stimuli which have previously been 
temporally contiguous with reward or pumshment These stimuli may 
either be “in the environment,” as m so-called discrimination experi- 
ments, or they may be available only if the subject himself produces 
them, by means of tentative, “exploratory” movements, as in a maze 
where external cues have been eliminated But the point is, simply, that 
these stimuli are sought or “consulted,” not for “information” inherent 
in them, but because they are conditioned to affecave states which 
will then serve to guide the subsequent course of overt behavior As 
Muenzmger has long since observed, VTE is not immediately evident 
in a rat, in its imtial trials in a discrimination apparatus or a T-maze — 
presumably because the cues have not yet become sufficiently condi- 
tioned to “good” or “bad” anticipations Moreover, as Muenzmger has 
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also noted, VTE ‘‘tends to disappear as soon as the habit [is] automa- 
tized ” What the latter statement presumably means is that clear 
anticipations of one as opposed to another course of action become 
conditioned to stimuli which occur prior to the subject’s reaching the 
“choice point” and so sets the animal for the correct turn in advance, 
thus eliminating the necessity for head-wagging debate at this point 
In a T-maze, well-trained rats can be seen ‘'hugging the wall” on the 
same side of the stem of the maze as the correct wing is located, thus 
indicating that their “minds are already made up” as to what they are 
going to do at the choice point, thus making VTE superfluous 

Rarely are the experimental facts so abundant or their implications 
so clear as they appear to be in respect to vicarious trial-and-error 
behavior Goss & Wischner, in the review cited, describe in considerable 
detail the many aspects of VTE which have now been systematically 
studied, and they promise a later review of theories concermng this 
phenomenon But the central fact stands out, unopposed, that we have 
here a superb illustration of an activity which is at one and the same 
time both symbolic (in a hmited way — see Chapter 4) and yet grossly 
observable 

IV An Electromechanical Analogue of VTE 

As a result of reading a preliminary draft of this chapter, Mr L D 
Hagenbook was reminded of the operation of a “tracking” device 
known as a Rawtn set This he has kindly described as follows 

In weather prediction, aircraft flight, and artillery and missile firing, 
precise measurements of atmospheric conditions at different altitudes are 
needed Some rather complex electronic equipment has been evolved to 
meet this need 

A high-frequency radio transmitter attached to a balloon is sent aloft 
The transmitter, being carried higher and higher, sends back information 
about temperature, air pressure, and humidity Besides the vertical ascen- 
sion, winds carry the balloon horizontally By trackmg this horizontal 
movement with a very accurate radio direction finder, mformation about 
wind speeds and directions are also obtained The radio direction finder 
currently in use is an entirely automatic servo-mechanism called a Rawin 
set (A servo-mechamsm is roughly any self-regulatmg electro-mechanical 
device ) The foUowmg is a description of how it tracks the radio trans- 
mitter sent aloft 

The antenna assembly of a Rawin set employs a large movable, parabolic 
reflector having the appearance of an over-sized salad bowl The goal in 
trackmg is to keep the axis of the parabolic reflector oriented on the trans- 
mitter To do this the Rawin set must get mformation telling it when it 
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IS off target and in which direction it must rotate the antenna assembly to 
get back on target As shown in the diagram below, there is a small dipole 
antenna located in front of the reflector Over the antenna is a round cup 
which rotates on an off-center axis A signal being received by the antenna 
assembly bounces off the reflector directed toward the rotatmg cup, it is 
then reflected off the rotating cup and picked up by the antenna The off- 
center cup rotates at a speed of 30 revs per second and its effect is to 
modulate the incoming signal at a frequency of 30 cycles per second 
Coupled to the motor (M) which drives the rotating cup is a generator 
(G) The generator also puts out a 30 cps signal When the antenna assem- 
bly IS “tracked-in” and the axis of the parabolic reflector is lined up with 
the balloon transmitter, these two signals are exactly in phase (le, they 
vary together) When the antenna assembly is not tracked-in, the modulated 
signal from the transmitter will be out of phase with the signal from the 
generator The amount of phase difference is a function of the location of 
the transmitter in relation to the axis of the parabolic reflector The modu- 
lated signal from the transmitter and the signal from the generator are fed 
into a phase-discriminating network This electronic circuit measures the 
difference in phases between the two signals, and by means of four different 
outputs (error signals) drives motors to turn the antenna system in any of 
the four possible directions on its two rotatmg axes Thus, if the antenna 
system is not on target, it will track-in by turning on either its horizontal 
axis, Its vertical axis, or both 



Drive motors 


Error signal 


Phase discrim- 
inating network 


Fig 6-1 Schematic diagram of a Rawin tracking apparatus (courtesy of L D 
Hagenbook, Jr ) 


To summarize A 30 cps signal from the transmitter is compared to a 
30 cps reference signal Differences m phase between these two result in 
an error signal acuvating drive motors to move the antenna assembly on 
target and subsequently to follow any course the transmitter might describe 
This is analogous to a rather complex stimulus-response relationship 
It may be mterestmg to note that a characteristic problem in servo- 
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mechanisms is “time lag” caused by the inertia of the mechanical parts 
This results in a slowness of response both in starting and stopping, a lag- 
ging of the mechanical “effect” behind the electromc “cause” To help 
counteract starting inertia m the Rawin tracking mechanism, each drive 
motor has current flowing through it in opposing directions even when 
not moving This yields a dynanuc equilibrium analogous to muscle tonus 
making possible finer and more rapid starting responses 

The other effect of time lag, slowness m stoppmg, results m mechamcal 
oscillation In this de\ice, so long as the reflector is off target the drive 
motors operate to move it on target The error signal will decrease and then 
stop as the antenna assembly gets on target, but due to inertia, the antenna 
assembly will over-shoot and swing off target agam The drive motors 
then operate in the opposite direction and again there is an over-shoot 
Oscillation occurs sustained by boosts from the drive motors To prevent 
oscillation, braking or damping devices have been employed In the Rawin 
set the dampmg is a signal tending to drive the motors in the opposite 
direction they are being driven by the error signal This damping signal 
IS a constant fraction of the speed of the motors When the error signal 
IS strong It over-rides the damping signal and the motors drive toward the 
target, but when the error signal decreases as the target is approached, the 
damping signal over-rides and throws the motors in reverse By this 
anticipatory action, movement is effectively braked Smce dampmg devices 
are needed in all fast acting servo-mechanisms, and since the human body 
with Its nervous system and muscle tissue is exactly analogous to a servo- 
mechanism, It IS mterestmg to wonder what kmd of dampmg devices are 
employed m the human body 

Like servomechanisms in general, the Rawin set is “error-actuated” 
(see Chapter 7) Whenever there is a discrepancy between the ideal 
and the actual, the apparatus is “motivated” and moves to correct this 
discrepancy Thus, we have self-regulation of the same “homeostatic” 
(drive-reduction, stabihzmg) sort as is found in living organisms 
When the apparatus is off target, there is a marked phase difference 
between the reference signal and the signal generated by the rotating 
cup, and this phase discrepancy then activates “adjustments” which 
eliminate the phase discrepancy and, in the process, put the apparatus 
on target, just as motives in hving organisms normally function so as 
to eliminate themselves and, in the process, achieve other ends, le, 
those of keeping the orgamsm alive and healthy According to Mr 
Hagenbook, a Rawin set can “track-in” when as much as 6 degrees off 
target to begin with and, once “on the beam,” can track with an error 
of less than 03 of a degree 

In terms of the purpose for which it was designed, this apparatus 
is obviously highly efficient, highly “intelhgent,” and Mr Hagenbook 
says that those who work with it easily fall into the practice of at- 
tnbuting “mental” qualities to it— it behaves so much like a living 
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organism But wherein does it instruct us in the psychology or strategy 
of thought^ Is not the little wabbling cup in the Rawin apparatus 
reminiscent of the rat’s wabbling head in a discrimination or choice 
situation^ When the antenna assembly is off-target, the cup (“head”>) 
feeds more of the signal to the antenna, and the phase discrimination 
network (“consciousness”^) is in a position i8o degrees removed And, 
as a result of continuously “sampling” back and forth, the “head” thus 
tells the “organism” (apparatus) as a whole which way to turn First 
the head goes this way and that, differential information is obtained, 
and orders are then issued to the “muscles” (motors) to move the 
whole body (antenna assembly) in the direction favorably explored by 
the head alone 

Various biologists and neurologists (eg, Sherrington, 1906, McCul- 
loch, 1951) have been interested in the fact that the heads of living 
organisms are normally the foremost part of the organism as it moves 
through space ® It “gets there first” and alters the line of progression 
of the rest of the body if the “there” is not good Of course, heads 
have become highly specialized in terms of the “special receptors” 
they contain, notably receptors which are capable of detecting stimuli 
at a distance^ viz , eyes, ears, nose But these specializations must have 
been preceded by the special organs of ^HoucV — such as provided by 
taste buds and vibrissae And perhaps even more primitive are the 
receptors which report which way the head is turned, or “headed ” If 
heading in one direction gets the orgamsm into trouble, it would seem 
highly prudential for an orgamsm to be troubled (secondarily, emo- 
tionally) ]ust on the basis of the stimuli produced by a token turn, 1 e , 
of the head alone 

Efficient and versatile as it is, the Rawm set is, of course, in one 
important respect decidedly inferior to orgamsms, even quite lowly 
ones It does not learn Perhaps, in one respect, this is an advantage 
It does not have to learn since all it needs to “know” is, literally, wired- 
in by Its maker By virtue of the way the apparatus is constructed it 
“automatically” operates “intelligently,” 1 e , given one form of in-put 
signal It does one thing, given another form of signal it does another, 
and both actions are correct Living organisms are to some extent 
similarly blessed in the form of instincts, these are, supposedly, re- 
action potentials which are “ready to go” on the basis of the very 

®The author recalls, from his days m government service during World War 
II, the picture of a turtle prominendy displayed in one of the staff rooms, with 
this legend “Remember the turtle— he makes progress only when his ‘neck is out ’ ” 
The moral, for both a government worker and the student of behavior, is clear ^ 
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construction of the organism, as opposed to experience The difficulty 
with instincts is, of course, the same as the “difficulty” with a Rawin 
set they may do what they were originally designed to do superbly 
M ell, but if conditions and demands are altered shghtly, their adaptive 
function may break down completely Living orgamsms, with then 
capacities not only for thought and action but also for learning, have, 
in the long run, a considerable advantage This is what Ashby means 
(Chapter 7) when he refers to the principle of “ultra-stabihty” mani- 
fested by hving orgamsms, 1 e , the capacity for a system to reorganize 
Itself and re-estabhsh functioning after a change in either environ- 
mental conditions or (through illness or damage) m the system itself 
Our discussion thus far has shown that thought and action are in- 
timately interrelated Thought-less behavior is, in general, very poor 
behavior, and thought, at least in some instances, is itself a form of 
behavior — ^miniature or token behavior But we now see that a system 
can have the capacity for both thought and action without necessarily 
having the capacity to learn Although, as the next section will show. 
It is possible to learn by means of thought, thought tends to presuppose 
learning As we have seen, learnings, meanings, significances can either 
be built in (Rawin sets, instincts)* or they can be derived from experi- 

^ Revised two-factor learning theory raises some interesting possibilities concern- 
ing the nature of instinct Some of the apparent mystery of instinctive activity has 
been dispelled by careful and detailed studies, such as those carried out by Wheeler 
(1928) It had been known for a long ume that in at least certain species of ants, 
there are so-called “nurse” ants whose “duty” it is to feed and otherwise care for 
the colony’s “nursery,” contaimng the developing eggs and young larvae In the 
steadfast way in which the nurse ants feed the larvae we seemed to have a striking 
example of instinctive altruism Day after day they carry great quantities of leaf 
cuttings and other coarse food to the larvae and stuff them to capacity, with no 
evident reward However, the perse\ering Wheeler finally saw something which 
others had overlooked Around the larvae’s mouth are glands which manufacture 
a sugary substance, and when the mouth of the larvae is well stuffed, the sheer 
pressure of the stuffing causes this “nectar” to be exuded, which is then lustily 
licked off by the altruistic (^) nurses There are, however, many other instances 
of behavior where it is much more difficult to demonstrate a pleasure-principle 
type of explanation and where the notion of inherited “connections” of some 
sort seems about the only alternative (see, for example, Thorpe, 1956) But in this 
connection Dr Norman Ginsburg, in a recent seminar, has made this suggestion 
If revised two-factor learmng theory is valid, does it not suggest a revised theory 
of “instinct” as welP If so-called habits are dependent, not upon drive-behavior 
bonds, but upon the particular meanings that have become conditioned to response- 
correlated stimuh, may it not hkewise be that instincts are inherited neural con- 
nections between response-correlated stimuli and certain meanings (hopes and 
fears) rather than such connecuons between drives (or other vaguer forms of 
stimulaaon) and specific responses^ Some of the differential predictions that 
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ence But, in either case, it seems that their principal function is then 
to affect thought and thus guide action, rather than to determine action 
m the more immediate sense implied by “habit” theory, as developed 
by Thorndike and Hull 

V Thought as Planning or '"Preconditioning'' 

At the human level one of the commonest and most important forms 
of thinking involves principles we have already explored in Chapters 
3 and 4, which deal with language Because the psychology of the 
sentence is the prototype for this kind of thinking and because sentences 
apparently are never made by infrahuman organisms and only rarely, 
if ever, fully understood by them, we may infer that the type of think- 
ing under discussion here is very limited, or completely nonexistent, m 
animals In principle, however, it is in no way incompatible with the 
type of animal thinking described in the two preceding sections 

The gist of the notion to be conveyed here has been put forward in 
a previous study (Mowrer, 1954), m the following words 

What I would like to say here about the nature of thought will be 
avowedly incomplete and no more than suggestive Let me begin with an 
example A few weeks ago, I took home to my seven-year-old son a box of 
small blocks and other scrap lumber from our departmental machine shop 
I knew the box, after the blocks were taken out, ought to be returned to 
the shop and so took it back to the psychology buildmg, but, at the time, 
the shop was locked so I put the box m a storage room — and, then, forgot 
about It for several days Later, at home, I remembered the box and thought, 
“Machme-shop door, box Machine-shop door, box” In more elaborate 
terms I was, I suppose, saying to myself somethmg like this “The next 
time I pass the machine-shop door I must remember to get and return that 
box to the shop ” Later, when walking down the hall on the way to my 
office, I passed the door, was remmded of the box, got it, and returned it to 
Its accustomed place 

What I had done, evidently, was to condition myselj in advance to the 
door, by usmg a symbol thereof, so that it would cue off the reaction of 
gettmg and returnmg the box I had, m other words, m the absence of the 
door (and the box, too, for that matter) — ^1 e , m the realm of the “not here, 
not now” — conditioned myself so that the door, on the basis of generaliza- 
tion from symbol to thmg, would brmg to mmd, or remind me, that I 
ought to do a particular think In effect, I had “talked to myself” and pro- 

flow from a bond vs feedback theory of habit have already been explored 
Whether a feedback theory of instinct would lead to expectations logically differ- 
ent from those generated by a bond theory of instinct must be determined by 
others particularly equipped to investigate the problem (cf Chapter 10, Sections II 
and III) 



224 


LEARNING THEORY AND THE SYMBOLIC PROCESSES 


duced a result apparently quite comparable to that which we have here 
made the basic criterion of objective sentence formation and interpersonal 
communication 

I would not hold that this is the only or even the most typical pattern 
which thinkmg takes Certainly planning and the consideration of alterna- 
m es w ould have to be carefully examined in this connection and may turn 
out to in\ olve something rather different More formal reasoning, e g , that 
imohed in mathematics, ma) also depart more or less critically from this 
pattern However, enough has been said to suggest that in at least some 
types of thmking, there is a process of self-stimulation and response, m- 
voKmg the subject-predicate relationship, which is similar to that involved 
m interpersonal stimulation and behavior alteration of the kind achieved 
by objectively expressed sentences In other words, in the light of the present 
analysis of sentence psychology, it now appears that we can “talk to our- 
selves” as well as to others and achieve thereby much the same outcome, 
namely, that of affectmg (conditionmg) an organism (oneself) in the 
presence of a mere symbol for something so that when that thing itself is 
later encountered, there will be a manifest change in behavior with respect 
to that thing ® 

Perhaps the kind of “thinking” just described is more likely to in- 
trude itself upon our attention when it fails than when it succeeds 
Normally the writer, in riding his bicycle from home to office in the 
morning, takes the same route One mormng, however, an errand made 
It desirable to take an unaccustomed turn The unusual turn was re- 
hearsed “in thought,” much as in the foregoing illustration, but then, 
when the time came, it was not made Soon thereafter the oversight 
occurred to the rider and he said something of this sort to himself “I 
forgot to take that turn, after all’” 

If asked why he had “forgotten,” the cyclist would have probably 
said, “Oh, I just w^asn’t thinking ” But now what does “thinkmg” mean 
in this context^ If the earlier “thinkmg” had done its work, the result 
should have presumably followed automatically, but it did not A 

® What we know about the role of repetition m language corresponds moderately 
well with common facts from the conditioning laboratory A signal and an elec- 
tric shock usually ha\e to be paired at least twice before an ammal such as the 
rat seems to “get the connection ” It is as if the chances are too great that one 
conjoint occurrence may be mere coincidence (Chapter 9), so that the reality of 
the relationship has to be established by at least a second conjunction of the two 
stimuh Small children seem to learn very quickly that a sentence twice repeated 
— “Pammy-kitty, Pammy-kitt}^” — ^is more effective than a smgle repetition thereof 
When we are trying to remeinber something, through a process such as described 
above, the association is also usually repeated at least two times, as a minimum 
This is not to deny that single repetitions of sentences often “do the trick,” but 
we have no way of knowing how often this is because the recipient “picks up” 
the sentence, so to say, and fixes and confirms it by subvocal rehearsal 
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Freudian might hold that such a “lapse” or “error” is dynamically de- 
termined the individual did not respond as he had planned or intended 
because he was really “ambivalent” about the action involved There 
were, within his personality, opposed, competing “wishes” which ex- 
pressed themselves, not openly, in defiance of the original plan, but 
subtly, at the critical moment of execution 

The possibihty cannot, however, be totally ignored that some epi- 
sodes of the kind described, perhaps a great many of them, are truly 
accidental In other highly complicated “systems” there are sometimes 
failures of operation which presumably cannot be explained as due to 
“unconscious wishes”, and it would be very surprising if an “apparatus” 
as compact as the brain and a “process” as intricate as the human 
mind did not occasionally fall short of perfection If one permits one- 
self to become preoccupied with thoughts about other matters, or if 
there is unanticipated distraction, or if there are “psychological” dis- 
turbances, such an oversight or failure might well occur without any 
unconscious countermotivation The very fact that one has “pro- 
grammed” a given action for a particular time and place (to borrow a 
bit of “computer” parlance) prompts one to feel free now to “think 
of other things,” on the assumption that the action, having been preset, 
will run itself off “automatically” or at least that there will be an 
automatic reminder when the propitious moment arrives All this is 
not, of course, to say that conflicting motivation may not, on occasion, 
express itself precisely as Freud suggested, what the facts do suggest 
is that not every error of this sort calls for an expedition into the un- 
conscious for a Freudian wish 

In our study of VTE we arrived at the conclusion that this fascinat- 
ing type of behavior is a device for helping an orgamsm get orgamzed 
— get “set” with respect to immediately imminent action — ^in answer 
to the question, “What to do next^^"" In contrast, the type of thinking 
we have just explored is concerned with “getting set” jor more remote 
behavior The question of whether this type of presetting or pre- 
conditioning can occur only in human beings or has at least some 
prototype in lower orgamsms will be considered in the next section 

VI Thought and the Delayed-Reaction Experiments 

The kind of presetting of action, or preconditioning, discussed in 
the preceding section is, in a sense, a form of delayed reaction This 
IS the essence of “planning” One cannot do it novo but will at a later 
time And we have seen how, by means of their elaborate symbolic 
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skills, human beings can get set for a specific action well in advance 
of Its actual occurrence The assumption has been, moreover, that 
infrahuman organisms, lacking symbols, are much less effectively plan- 
ful Although not usually placed in just this context, there is a large 
experimental literature on delayed reaction in animals which provides 
a clear-cut answer to the question here implied This literature has been 
admirably summarized and interpreted by Osgood (1953)^ follows 

The delayed reaction In an early approach to this question. Hunter 
(1913) tested the ability of both rats and human children to make delayed 
reactions The rats were first trained to run to whichever of three doors 
was lighted After this habit was well established, a delay interval was in- 
serted between flashing a light over one of the doors (distinctive cue) and 
releasing the animal, the rat being held in a glass-sided box throughout this 
period With the children, an attractive toy was dropped mto one of three 
boxes and, after a delay interval, the child was allowed to look into one of 
three boxes for the toy In both cases the distinctive cue is not available at 
the time the correct response must be made, to the extent that correct re- 
sponses are made beyond chance frequencies, some symbolic, representative 
processes must be functioning Hunter found that the maximal delay for 
the rat was about 10 seconds and even then success seemed to depend upon 
the animal’s maintaining bodily orientation toward the correct door Chil- 
dren, on the other hand, were not only capable of much longer delays but 
could respond successfully without mamtainmg any specific overt orienta- 
tion That the actual length of delay for the rat depends upon specific 
experimental procedures is shown by the results of other investigators 
Honzik (1931) allowed his animals to run toward the relevant cue before 
It was removed, thus msuring that the rat actually received the stimulus, 
and he obtained delays of 45 seconds or more McCord (1939a) found rats 
capable of delays of 4 or more minutes He used a square enclosure with 
distinctive cards on each of the four sides, the rats being required to jump 
from a central stool at the form under which the experimenter had previ- 
ouslv held and withdrawn a food cup The fact that the four alternative 
cues were separated by 90° angles m this case, thus mimmizmg the likeli- 
hood of interference from conflicting response tendencies during the delay 
period, probably facilitated the maintenance of the correct set 

Other species have been used as subjects in delayed reaction experiments, 
and maximum delays are highly variable The cat has been found capable 
of delays of from 3 to 17 hours (Adams, 1929), the monkey 15 to 20 
hours (Tmklepaugh, 1928), and the chimpanzee as long as 48 hours 
(Yerkes and Yerkes, 1928) These values can only be considered sug- 
gestive since experimental procedures varied widely Nevertheless, a certain 
trend m data is apparent the length of the delay interval increases with 
the phylogenetic level of the organism Another general conclusion seems 
warranted as well Hunter (1913) had observed that his rats could delay 
successfully only if they maintained bodily orientation toward the correct 
door, McCord (1939) increased the discriminability of the alternative cues 
and obtamed longer delays, the capacity of both human children and 
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adults to make delayed reactions is known to depend upon the character of 
the intervening activity The length of the delay interval vanes with the 
nature of the interpolated activity We shall return to this point again (pp 
656-657) 

A few pages later this writer again picks up the matter of delayed 
reaction and deals with it thus 

Animals can perform delayed reactions and double alternations success- 
fully and they can learn through observation and msight, all these activities 
seem to share a dependence upon certain symbolic processes, termed “repre- 
sentative factors ” Since the relevant cue is not present at the time the 
correct response is made, the animal must supply itself with some distinctive 
cue, some mode of representing what is lacking in the present external en- 
vironment The fronti lobes have been shown to play an important role in 
such performances — ^whether as the locus of mediation processes or merely 
as a facilitative agent is not yet clear From mtrospective reports we are led 
to believe that the human animal stimulates himself with distinctive verbal 
cues in situations of this sort By what process does the subhuman organism 
mediate between past and present experiences^ 

Overt motor orientation A simple explanation, attributing little in the 
way of higher level capacities to subhuman species, is that the animal main- 
tains an overt muscular “set” toward the relevant cue until the correct 
response can be made Hunter (1913) beheved that rats and dogs were 
limited to this level of performance These animals “pomted” toward the 
light which flashed and held this motor orientation until released Forcing 
them to change position resulted m failures Although this is undoubtedly 
one method of bridgmg a temporal mterval, it is clearly not the only possi- 
bility for an animal Raccoons and preverbal children did not need to main- 
tain a motor “set,” and even the humble rat may be able to perform delayed 
reactions when their motor orientations are disturbed (Honzik, 1931) 
Furthermore, this explanation would not explam successes m double alterna- 
tion, observational learnmg, and insightful problem-solvmg 

Implicit motor orientation There is, of course, no reason why a mediatmg 
motor “set” should be either overt or obviously related to the goal- 
object in question When the human adult thmks “it’s behind the third 
door,” the observer cannot see the response, and there is no essential relation 
between thinking “third” and the actual goal-place beyond the representmg 
relation itself The animal might conceivably mamtam an mcreased tension 
m the muscles about the left eye after a light has flashed on that side, the 
stimulation from this response serving as the distmctive cue once the delay 
interval is over (cf Hull’s “pure-stimulus act,” 1930b) Such a hypothesis, 
attractive, though it may be, is practically untestable Where in the 
organism are we to look for the specific muscle system bemg used for 
mediation^ In any case, what meager evidence exists is in the negative 
Loucks (1931) administered a general anesthetic durmg the delay period 
and found his rat subjects still capable of successful delayed reactions 

Representation and retention Is it actually necessary that any activity 
persist through the delay interval in order that successful mediation occur^ 
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The only requirement is that some distinctive cue be given at the time the 
correct i espouse must be made If our human subject learns to say ‘ht’s be- 
hind the third door” at the time of origmal presentation, he does not need to 
keep repeatmg the phrase during the retention interval, all he must do m 
order to demonstrate a delayed reaction hours or even days later is to recall 
“it’s behind the third door” when agam brought mto the test situation 
Similarly, the rat does not have to maintain tension m the muscles about 
the left eye throughout the delay period, it merely has to “remember” to 
make this response at the time of release and thus provide itself with the 
distmctive cue This interpretation clearly places “representative factors” 
on a contmuum with ordinary retention Are there any differences? There 
appear to be two salient ones ( i ) Only a single trial is provided for origmal 
impression (except for whatever implicit repetitions are made by the 
organism during the interval) (2) The stimulus in the test situation is not 
identical with that durmg origmal learnmg (the relevant cue is missing) 
The latter difference between origmal and test situations is probably bridged 
through generalization (pp 663-664) 

That animals can, relatively successfully, make plans for future ac- 
tions, w^here such plans are based upon spatial arrangements, seems 
clear from the foregoing evidence and discussion They have, as Os- 
good puts It, fairly adequate representational or mediate processes by 
means of which prior spatial learning can be retained and reinstated 
But here the matter seems to end Yerkes, for example, working with 
chimpanzees, asked (in effect) this question Can these orgamsms 
“make plans” where the execution of the intended (delayed) action 
is dependent upon yio^zspatial cues? As the following discussion, 
quoted from Yerkes (1943), indicates, the answer appears to be No 

In each of four corners of a large room there was placed a small wooden 
box with hmged lid The boxes were identical m size, shape, and surface 
texture, but they were pamted white, black, red, and green respectively 
The chimpanzee subject was tied to a post m the middle of the room equi- 
distant from the boxes, while the experimenter ostentatiously put its break- 
fast mto one of them and closed the lid The animal was then taken away 
to Its hvmg quarters and durmg its absence the boxes were mterchanged 
After a defimte mterval the animal was brought back and from its central 
position m the room given opportunity to choose from among the boxes 
the one m which the food had been hidden and to approach it, and in case 
of correct choice take the food Under the circumstances, successful choice 
seemmgly must depend on memory for the visual appearance of the box 
With a short period of delay, say five mmutes, between seemg the food 
concealed and opportumty to try to locate it, this problem would seem to 
us very simple and we should naturally suppose that the hungry ape would 
rarely miss its breakfast Normal human subjects ordinarily would find 
such a test easy to meet successfully What actually happened in the experi- 
ment IS more than surpnsmg, it is indicative of a highly significant per- 
ceptual characteristic of the chimpanzee 
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Actually when a subject responded in the four-box situation it chose, 
irrespective of color, the box which happened to be in the corner where 
the food had been concealed, and despite the severe penalty of missing 
breakfast, this same type of incorrect response tended to persist and might 
be repeated several times in succession, with increasing emotional dis- 
turbance, violence of protest, and either prolonged delay for a comparison 
of the boxes prior to choice or refusal to make a choice I recall mstances 
in which a subject, having opened the box which was m the position where 
It had seen the food placed, searched thoroughly within and without the 
box as if unwilling to trust its senses, and then, throwing itself on the empty 
box, cried piteously 

That m this experiment the dominance of the spatial factor was amazingly 
strong IS evident, but one may suspect that the subject either was unable to 
distinguish the boxes by their color or, finding it very difficult to do so, 
made its choice on the basis of position or location in the room (pp 104--105) 

In the passage already quoted from Osgood, reference is made to 
the fact that the capacity to hold a response “in suspension,” for a 
delay period after the cue stimulus has been given and has disappeaied, 
appears to be specifically related to the functiomng of that part of the 
brain known as the frontal lobes This is inferred from two sources of 
evidence ( i ) as one ascends the evolutionary scale one finds (a) pro- 
gressive development of this capacity and (b) elaboration of the frontal 
lobes, and (2) surgical assault upon the frontal lobes typically impairs 
this capacity The results of an experiment by Lawicka (1957b) are 
typical In a large rectangular room, a dog would be tethered on one 
side and three food trays fanned out in front of him, some feet away 
A light would be flashed or a buzzer sounded near one of the trays 
(the baited one) , and, after a delay, the dog would be released If it 
immediately went to the correct tray, the presumption was that it had 
in some way held that tray “in mind” during the delay period Normal 
(unoperated) dogs were able, under these conditions, to respond cor- 
rectly after delays of as much as 10 minutes During the delays they 
did not have to maintain a fixed bodily orientation, they were not dis- 
turbed by intervening stimulation of various kinds, and they could 
even be briefly removed from the experimental situation without im- 
pairing their ability, when released, to make the correct choice 

The dogs [with prefront lesions] differed strikingly m the performance 
of any of the above tests 

1 ) They were unable to choose the correct f oodtray even after a delay 
of several mmutes, but they did so only if during the whole delay period 
the orientation of their body towards this foodtray had not been changed 

2) If during the delay period they changed their posture for one reason 
or another, they would go to the foodtray towards which they had been 
oriented when released 
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3) All extraneous stimuli sufficiently strong to orient the animals in 
another direction disturbed the right delayed response 

4) The prefrontal dogs were unable to make a correct choice when 
moved away from the starting place (p 108) 

Here is a clear indication that the central processes involved m de- 
layed reaction are mediated by the frontal lobes and that, when they 
are disconnected, the dog is limited to a much more primitive and 
less efficient peripheral mechanism, involving posture fixation 

Thought, like love, is a “many-splendored thing”, and there is no 
guarantee, because one form thereof is associated with a particular part 
of the brain, that all its forms are also thus localized But, in general, 
there is a tendency for the more complex psychological operations to 
be mediated by the most recently evolved parts of the nervous system, 
the correlation just reviewed being typical of many others 

VII Insight or ''Putting Things Together" 

Insight, as the expenence of having ideas suddenly “click into place,” 
is familiar to everyone Yet psychologists have had difficulty deciding 
how to classify and explain it The Gestalt school has attempted to 
make insight a substitute for learmng, holding that solutions to prob- 
lems are really arrived at suddenly, if at all, and that the progressive, 
little-by-little nature of learmng is an illusion This position, as on- 
going research and theory construction have pretty conclusively shown, 
IS too sweeping in its imphcations On the other hand, learmng theorists 
of the stimulus-response camp have been reluctant to recogmze insight 
as in any way unique or distinctive and have tried to derive the cited 
instances from simple S — R principles (see, for example, N E Miller 
on the problem of mediation. Chapter 2) 

Pending a more defimte settlement of this issue, one may tentatively 
adopt the position that insight and learning are different, even anti- 
thetical (cf Maier, 1931, Hilgard, 1956, p 6) As suggested previously 
(Mowrer, 1950), learmng may be regarded as essentially an inductive 
(experiential) process, whereas insight is more deductive (logical) in 
character 

In its simplest form, deduction is nothing but an instance of the mdi- 
vidual’s deciding, “This is a case of that ” Thus, in the familiar syllogism 
previously referred to, if we know that “All men are mortal,” as soon as 
we decide or discover that “Socrates is a man,” we immediately know that 
“Socrates is mortal ” Socrates may be an entirely new experience to us, as 
such, but as soon as we can classify him, as soon as we can relate him to 
other members of a category with which we have had experience, we can 
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then bring our past learning to bear upon him and properly feel that, in 
some measure, we “know” him too — and what expectations we may properly 
have with respect to him Obviously, this may save us a lot of time and 
trouble over what would be mvolved if we had to start fresh with every 
new organism or situation we encounter (p 335) ® 

It IS, however, perhaps not quite fair to equate insight to logical de- 
duction, especially in view of the harsh things that have often been 
said of the latter and the obvious importance and refreshing quality of 
the former Let us, for example, listen to Bertrand Russell 

[Deductive] mference is supposed to be a mark of mteUigence and to 
show the superiority of men to machines At the same time, the treatment 
of inference in traditional logic is so stupid as to throw doubt on this 
claim, and syllogistic mference, which was taken as the type from Aristotle 
to Bacon (exclusive), is just the sort of thing that a calculatmg machme 
could do better than a professor I have never come across any 
case of new knowledge obtained by means of a syllogism It must be ad- 
mitted that, for a method which dommated logic for two thousand years, 
this contribution to the world’s stock of information cannot be considered 
very weighty 

The inferences that we actually make [mductively] m daily life differ 
from those of syllogistic logic in two respects, namely, that they are im- 
portant and precarious, instead of being trivial and safe [see Chapter 9] 
The syllogism may be regarded as a monument to academic timidity if an 
inference might be wrong, it was dangerous to draw it So the mediaeval 
monks, m their thmking as m their hves, sought safety at the expense of 
fertility (1927, pp 79-80) 

In what sense, then, is insight more truly exciting and significant^ 
The early but never surpassed observations of Kohler (1927) provide 
many dramatic instances, of which we select a classic example Sultan, 
a young chimpanzee, is in a large enclosure separated by bars from an 
adjacent area In the latter the experimenter places a banana, just out of 
reach, through the bars, by means of either of the two sticks with 
which the ape has been provided Says Kohler 

His sticks are two hollow, but firm, bamboo rods, such as the animals 
often use for pulling along fruit The one is so much smaller than the 
other, that it can be pushed in at either end of the other quite easily Beyond 
the bars lies the objective, just so far away that the animal cannot reach it 
with either rod They are about the same length Nevertheless, he takes 
great pains to try to reach it with one stick or the other, even pushmg his 
right shoulder through the bars When everything proves futile, Sultan 
commits a “bad error,” or, more clearly, a great stupidity, such as he made 

® For discussion of the role of labeling or classifying in concept formation and 
mediation, see Mowrer (i960, Chapter 12) and Chapter 2 of this book, also Section 
VIII of this chapter 
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sometimes on other occasions He pulls a box from the back of the room 
towards the bars, true, he pushes it away again at once as it is useless, or 
rather actually in the \vay Immediately afterwards, he does something 
which, although practically useless, must be counted among the “good 
errors” he pushes one of the sticks out as far as it will go, then takes the 
second, and with it pokes the first one cautiously towards the objective, 
pushing It carefully from the nearer end and thus slowly urgmg it towards 
the fruit This does not always succeed, but if he has got pretty close m 
this way, he takes even greater precaution, he pushes very gently, watches 
the movements of the stick that is lying on the ground, and actually touches 
the objective with its tip Thus, all of a sudden, for the first time, the contact 
“animal-objective” has been established, and Sultan visibly feels (we humans 
can sympathize) a certam satisfaction in having even so much power over the 
fruit that he can touch and slightly move it by pushing the stick The pro- 
ceedmg is repeated, when the animal has pushed the stick on the ground 
so far out that he cannot possibly get it back by himself, it is given back to 
him But although, in trying to steer it cautiously, he puts the stick m his 
hand exactly to the cut (i e , the opening) of the stick on the ground, and 
although one might think that doing so would suggest the possibility of 
pushmg one stick into the other, there is no mdication whatever of such a 
practically valuable solution Finally, the observer gives the animal some 
help by putting one finger into the opening of the stick under the animal’s 
nose (without pointing to the other stick at all) This has no effect, Sultan, 
as before, pushes one stick with the other towards the objective, and as this 
pseudo-solution does not satisfy him any longer, he abandons his efforts 
altogether, and does not even pick up the sticks when they are both again 
thrown through the bars to him The experiment has lasted over an hour, 
and IS stopped for the present, as it seems hopeless, carried out like this 
As we intend to take it up agam after a while, Sultan is left in possession of 
his sticks, the keeper is left there to watch him 

Keeper’s report “Sultan first of all squats mdifferently on the box, which 
has been left standing a httle back from the railmgs, then he gets up, picks 
up the two sticks, sits down agam on the box and plays carelessly with 
them While domg this, it happens that he finds himself holding one rod in 
either hand m such a way that they lie in a straight Ime, he pushes the 
thmner one a little way mto the opening of the thicker, jumps up and is 
already on the run towards the railmgs, to which he has up to now half 
turned his back, and begins to draw a banana towards him with the double 
stick I call the master meanwhile, one of the animal’s rods has fallen out 
of the other, as he has pushed one of them only a little way into the other, 
whereupon he connects them agam ” 

The keeper’s report covers a period of scarcely five minutes, which had 
elapsed since stopping the experiment Called by the man, I continued ob- 
servation myself Sultan is squattmg at the bars, holdmg out one stick, and, 
at Its end, a second bigger one, which is on the pomt of f allin g off It does 
fall Sultan pulls it to him and forthwith, voith the greatest assurance, pushes 
the thinner one m agam, so that it is firmly wedged, and fetches a fruit 
with the lengthened implement But the bigger tube selected is a httle too 
big, and so it slips from the end of the thinner one several times, each time 
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Sultan rejoins the tubes immediately by holding the bigger one towards 
himself m the left and the thinner one in his right hand and a little backwards, 
and then sliding one into the other [Fig 6-2] The proceeding seems to 
please him immensely^ he is very lively, pulls all the fruit, one after the 
other, towards the railings, without taking time to eat it, and when I dis- 
connect the double-stick he puts it together again at once, and draws any 
distant objects whatever to the bars (pp 125-128, italics added) 



Fig 6-2 The ape, Sultan, making a double-snck (Kohler, 1927, opposite p 128) 

As we look back over this graphic description, what “insights” sug- 
gest themselves concermng insight^ What, more precisely, is it^ Sultan 
clearly wanted a longer stick If he had had a longer one, he would 
undoubtedly, in the course of variable behavior, have used it But the 
fact was that he had only two short sticks Neither alone could en- 
able him to solve the problem, and so eventually, as Kohler says, the 
subject gave up “for the present” and reverted to playing “carelessly 
with them ” Now where, exactly, did the insight take placed Did 
Sultan suddenly “have the idea,” or “realize,” that he could make a 
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longer stick by joining the two short ones together^ “It happens,” says 
the keeper, “that he finds himself holding one rod in either hand m such 
a way that they lie m a straight line, he pushes the thinner one a little 
way into the opemng of the thicker ” Thus far it does not sound 
as if the ape has had any great Ah-Haa’ experience It was not that he 
was sitting quietly “thinking” and suddenly jumped up and ran to the 
sticks and picked them up and confidently joined them No, he was 
playing with them carelessly and inserted one into the other only a 
little ax^ay Up to this point, Sultan’s behavior seems to have been chai- 
acterized by the vagueness and variability of bafilement But then, sud- 
denly, something happened and Sultan “is already on the run towards 
the raihngs and begins to draw the banana toward him with the 
double stick ” The insight was apparently largely a matter of sight 
suddenly the ape sanx that he, in fact, had a long stick (cf Hilgard, 
1956, p 226) This fact now completely altered the situation, from 
“hopeless” (Kohler’s own term) to hopeful, and released the banana- 
seeking behavior again 

If we are to make further progress with this analysis, the time has 
now obviously come to note that there are two levels of need, drive, 
or “problem” involved here one, the primary need for food and the 
derived need for a long stick That the ape was enormously pleased at 
finding himself (unexpectedly^) in possession of a long stick seems 
clear Therefore the stimuli associated with the more or less random, 
accidental joining of the sticks must, per theory, have taken on strong 
secondary-reinforcing potency, with an ensuing tendency to repeat 
this action “Each time Sultan rejoins the tubes immediately by hold- 
ing the bigger one towards himself m the left and the thinner one m 
his right hand and a little backwards, and then sliding one into the 
other The proceeding seems to please him immensely ” No banana yet, 
just stick’ No hunger reduction, just relief I can get the 

banana’” 

That sudden “insight” often involves sudden, secondary, revoard is 
suggested by an experiment carried out some years ago by two of the 
writer’s students, Dorothy Kunberger and Kaya Kardash (Mowrer, 
1950, Chapter ii) Hungry rats, placed in an oblong compartment, 
found that whenever a tone sounded, a pellet of food would appear in 
the food box located at the left end of the compartment As soon as 
the rats had reached the point that they would immediately run to the 
food trough upon hearing the tone, they were divided into two sub- 
groups A small brass bar was made available at the right end of the 
apparatus, approximately 30 inches from the food trough Depression 
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of the bar would, in any case, now cause a pellet of food to roll (noise- 
lessly) into the food trough, but the procedure followed with the two 
subgroups of subjects differed in that, with one group (experimental), 
whenever the bar was pushed it would cause the tone to sound (as well 
as deliver food into the trough), while with the other (control) group, 
bar depression produced food but no tone 

Under these circumstances the control-group rats failed to acquire 
the bar-pressing “habit ” In the course of their exploratory wanderings, 
they would occasionally push the bar and cause the food to roll into 
the trough, but such a long interval would usually elapse before they 
got back to the trough that they would not “see the connection,” be- 
tween bar pressing and food delivery What got reinforced, instead, 
were the responses last made before finding food in trough, which in- 
cluded approaching the trough and certain irrelevant bits of behavior 

By contrast the animals in the experimental group learned to press 
the bar as a means of obtaining food, very rapidly The instant they 
pressed the bar they experienced the secondary reinforcement pro- 
vided by the tone, so that the tendency to press the bar was in this 
way strengthened, and, more than this, the hearing of the tone also 
released, or cued off, the response of running to the food trough and 
thus also receiving, relatively quickly, primary reinforcement from the 
food Itself 

It will be immediately clear that this was a situation in which the 
temporal interval between an instrumental response and a delayed pri- 
mary reward was “bridged” by means of a secondary reinforcer (cf 
Mowrer, i960. Chapter 10) But what, one may ask, does all this have 
to do with “insight”^ The parallels to the case of Sultan and the sticks 
are not umnstructive Suppose that Sultan had been incapable of experi- 
encing any secondary reinforcement upon first (randomly) joining 
the sticks^ How long would it have been, one wonders, before he 
would have found that the compound stick would reach the banana^ 
Then and only then would Sultan have been primarily rewarded for 
putting the sticks together, and so many other actions would probably 
have intervened that they^ rather than the stick-) oining, would have 
been strengthened After a great deal of further experience in the 
situation, Sultan might eventually have learned, on the basis of primary 
reinforcement alone, how to fit the sticks together and then get the 
banana, but the chances of success are obviously much better if there 
can be an immediate secondary reward for this action ^ The analogy 

K. consideration which has thus far been merely implied should now be made 
explicit namely the source of the secondary reinforcement in the Sultan experi- 



236 LEARNI NG THEORY AND THE SYMBOLIC PROCESSES 

to pressing the bar and getting or not getting the tone in the Kunberger- 
Kardash experiment ill be obvious 

Prior to 1925, stimulus-response learning theorists, if they spoke of 
drive and drive reduction at all, spoke only of primary drives, such as 
hungei and thirst Kohler saw that Sultan was rewarded (“pleased”) 
well before he got the banana and realized the inadequacy of S — R 
theory (as then conceived) to explain what he so clearly witnessed 
Whether Professor Kohler would today accept the notion of im- 
mediate secondary reinforcement as satisfactorily accounting for 
Sultan’s behavior or w ould still insist upon invoking “insight” in some 
more abstruse form is not certain But this much is clear as S — R 
learmng theory has become more and more fully elaborated. Gestalt 
psychology has lost much of its peculiar cogency and appeal As in- 
dicated both here and repeatedly in other parts of this volume (see, 
for example. Chapter 2) and in the compamon volume (see, for ex- 
ample, Chapter 9), we seem to be moving, at last, toward a truly unified 
conceptual scheme 

VIII Rudimenfary Reasoning and Concept Formation 

As will already be apparent to the reader, terminology concermng 
the “higher mental processes” is not very exact Certainly “thought,” 
“insight,” and “reasoning” have common features and overlap in their 
meamngs It is therefore not surprising to find that the use of one 
rather than another of these terms in a particular context is often more 
dependent upon historical accident than logic VTE has been called 
“overt thmlang ” The behavior of Kohler’s ape, Sultan, has been 
termed “insight” And certain other experiments have been said to 
show reasoning in primitive form, although the terms “thought” and 
“insight” would seem, perhaps, equally applicable 

Begmmng in 1929, Maier has published a long series of ingenious 
experiments with rats which he has interpreted as showing “reason- 
ing” However, because of somewhat greater simplicity, we shall 
consider here a similar type of experiment reported by Tolman in 
1932 With admirable clarity, Garrett (1955) has summarized this 
experiment as follows 


ment It has already been noted that Sultan was pleased when he found he had, 
in fact, made a longer stick This could only have occurred, presumably, as a 
result of prior experience with such a stick Or at any rate he knew he needed 
a longer stick, and when he found he had one, this may be assumed to have pro- 
vided the immediate, secondary reinforcement — and the “insight” that he had 
done the right thing in putting the sticks together 
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Some psychologists believe that reasoning can be inferred when animals 
solve problems which demand the abihty to see relations, combine past 
experiences m new ways, and make generalizations from observations [Fig 
6-3] illustrates a maze used in the study of reasoning m the x^hite rat 



Fig 6-3 Floor plan of maze used by Tolman (1932) m studying “reasoning” in 
rats (from Garrett, 1955) 


There are three pathways from the startmg point in the maze to the food 
box Path I IS the shortest and most direct, path 2 is somewhat longer than 

1 (because of the detour), and path 3 is the longest Note that paths i and 

2 have a common section not traversed by path 3 In preliminary trammg, 
path I IS blocked at A, and the rats must learn to retrace path i and take 
path 2 When 2 is also blocked at C, the rats must take path 3 In the final 
tests (after trammg), paths i and 2 are blocked at B, just below their com- 
mon section Nearly all of the rats, finding path i blocked m the final tests, 
retraced their course and took path 3, not path 2 This result led the experi- 
menter to conclude that since path 2 had been preferred to path 3 previ- 
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ously, the rats had “inferred” that B blocked the common path Expressed 
differently, the rats had “put two and two together” and come out with 
four, that is, had “figured out” the right answer 
Animals can learn many complex tasks which require the sensible organi- 
zation of elements m such a way as to reach a correct solution But smce 
animals do not possess language, it seems unhkely that they employ verbal 
symbols or set up hypotheses m the way human beings do Although rea- 
sonmg does not always have to be carried on by means of symbols such as 
words, numbers, and maps, the solution of many problems, especially those 
m mathematics, is virtually impossible unless acceptance and rejection of 
alternatives can be expressed m symbols (pp 418-419) 

The expression, “putting two and tw o together,” is obviously used 
here m such a way as to mean something rather different from “putting 
things together” in the way exemplified by Sultan In that experiment 
there was a literal putting together of things, two physical things In 
the experiment just cited,® what are the “two” and “two” which are 
said to be related^^ By the use of a syllogism the question can be 
answered very mcely 

Path I and path 2 have a common segment 
Path I IS blocked in the region of this segment 
Therefore path 2 is blocked 

But how, precisely, does a rat make such an inference^ As Garrett 
points out, ammals do not possess language and hence cannot set up 
propositions of the kind involved in the foregoing syllogism Yet, in 
practice, rats seem to have some equivalent, nonverbal means of cop- 
ing with a situation of this sort And, in fact, it is not at all difficult 
to derive an explanation of this phenomenon from formal theory, 
though we cannot be sure that such a derivation is very similar to 
what happens in terms of the rat’s own view of the matter Briefly, 
path I and path 2 are more alike^ by virtue of the rather long common 
segment, than are paths i and 3 or paths 2 and 3 (where there is also 
a common segment but it is extremely short) Hence, if, as a result of 
encountering a barrier at B, the rats develop a negative “attitude” to- 
ward path I, this attitude (emotion, meaning) will generalize more 
strongly to path 2 than to path 3 ® 

®For other experiments of a related kind, where the attempt to demonstrate 
“reasoning” has not always been successful, see Crannell (1940), Dove & 
Thompson (1943), Keller & Hill (1936), Kuo (1937), Evans (1936) 

® At several earlier points m this chapter, as well as in the above paragraph, the 
reader will no doubt have sensed a relationship between the phenomena presently 
under discussion and the concept of mediation, as developed in Chapter 2 There 
It was concluded that, m the £nal analysis, mediation mvolves a form of tranter 
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A possible check on the foregoing interpretation could be carried 
out as follows Suppose, again, that there are three routes to a common 
goal, but that now the communality consists of the colo? of the path- 
ways rather than identical segments Two of the paths, let us say the 
middle one and the one at the left, are black, while the third path, 
the one at the right, is 'white Now block the middle (black) path, 
if our “reasomng” is correct, rats will be more likely to resort to 
the white path than to the other black one, although both are equally 
open and accessible physically 

If “reasomng” of the kind )ust described is dependent upon generali- 
zation, then we should examine concept joimation in the same con- 
text, for It, too, seems to be related to generalization in a special way 
Here again we quote from Garrett 

Experiments (Goldstein, 1939) have shown that a person who has suffered 
brain injury may lose the capacity to think in abstracted terms, even w’^hen 
his ability to take a “concrete attitude” — one controlled by immediate sense 
impression — ^is unimpaired Suppose that objects of different form, color, 
material, or use are presented to a subject who is told to “put together those 
things that belong together” The subject’s method of classifymg reveals 
whether he is employmg concrete or abstract concepts Grouping on the 
basis of form or color (usmg a general category) is taken to mdicate an 
abstract attitude — ^that is, the use of an abstract concept If, on the other 
hand, the subject groups only identical or nearly identical objects, or those 
that belong together by virtue of some specific use, his attitude is “concrete ” 
To illustrate, a subject takes the abstract attitude when, for example, he 
puts mto the one category of “tools,” hammers, screw drivers, saws, and 
nails of different size and shape The subject takes the concrete attitude if 
he selects one hammer and one nail, statmg that one hammer is enough to 
drive one nail Again, the attitude is abstract when pipe, cigar, matches, and 
ashtray are all classified under smoking materials, it is concrete when the 
subject selects one cigar and one match on the grounds that after dmner one 
match IS enough to light one cigar 

The test blocks shown [in Fig 6-4] have been widely used in the experi- 
mental study of concept formation This test (E Hanfmann & J Kasanm, 
1937) consists of twenty-two blocks m five colors, six shapes, two heights 
(tall and flat), and two sizes (large and small) On the hidden underside 
of each block is prmted a three-letter nonsense syllable which serves to 
define a block type All lag blocks are tall and large, all mur blocks tall and 

or generahzatio?! Such generahzation is manifestly involved in the above example 
of “reasoning ” For an excellent discussion of and review of the literature relevant 
to “medianonal processes” in relation to reasomng and problem solving in general, 
with special reference to the role of verbal factors, see Gofer (1957) 

“The reader may wish to relate the following discussion to the notion, de- 
veloped in Chapter 4, that the sentence can be thought of as a reclassification de- 
vice 
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small, all hk blocks flat and large, and all cev blocks flat and small Color 
and shape are irrelevant as far as classification is concerned and are really 
distractors, size and height being the important variables The examinee is 
told that there are jour kinds of blocks and that he is to find the four kinds 
and put them together As a starter he is given one block of a kind (a lag, 
for instance), and is told to sort out all of those blocks which belong with it 



Fig 6-4 Hanfmann blocks, designed for the investigation of concept formation 
(reproduced through courtesy of the C H Stoelting Co ) 

The subject is free to proceed as he pleases, except that he is not allowed to 
invert a block or read its name After a sortmg m which perhaps all blocks 
of the same color or shape have been grouped, the experimenter pomts out 
one wrongly selected block and tells the subject to try again The test 
continues, with the same directions for the other three types, until all four 
classifications have been made correctly The experimenter seeks to deter- 
mme whether the subject has used a logical hypothesis (all lag blocks are 
tall) or has followed a trial-and-error or guessing procedure Like the tasks 
described above, the object is to discover how quickly the subject is able to 
detect the basis of classification — ^that is, whether he can grasp an abstract 
concept Young children and low-grade adults, as well as patients suffermg 
from mental disease (for example, schizophrenia) or bram mjury, usually 
take the concrete attitude each block is treated as a separate stimulus- 
object, and there is an inability to generalize or to group m terms of abstract 
quality (pp 421-423) 

What then, more precisely, ts concept formation^^ We are told in 
the quotation that, in the Hanfmann test, color and shape are not 
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admissible as bases for classifying the blocks Surely these are the most 
obvious, most concrete dimensions in which the bfocks vary, but they 
are ruled out, for the very reason that they are so obvious Here a 
category, or class, or “concept” depends upon quite simple forms of 
“similarity ” Color and form are immediately discernible and do not 
require much in the way of “thought” or “abstraction ” On the other 
hand, in classifying the blocks in the four required ways, as large-tall, 
small-tall, large-flat, and small-flat, the subject has to generalize or 
classify on the basis of characteristics which are not so immediately 
apparent or common Thus there is a tendency to speak of concept 
prmation, for the reason that the generalization has to be made^ as 
a result of some sort of psychological activity In Chapter 1 1 of Learn- 
ing Theory and Behavior we have examined the phenomenon of 
sensory generalization, in so-called concept formation, we are dealing 
instead with generalization which is more subtle, not so simple or 
immediately evident As previously noted, sensory generalization seems 
to occur on the basis of some largely innate mechanism, “concept 
formation,” by contrast, is harder to come by, takes more “gray mat- 
ter ” Here capacity to use symbols seems crucial If one could not say 
“Large and tall,” “Large and flat,” etc , it seems unlikely that he could 
see the four “classes” of blocks which the test calls for Here gen- 
eralization and classification depend not so much upon the properties 
of the objects themselves as upon the symbols applied to them If theie 
are certain objects to which one can say, “Large and tall,” then they 
become “alike” even though differing radically in other lespects, notably 
color and shape Hence we emerge with the deduction that so-called 
concept formation is really a matter of mediated^ rather than “im- 
mediate,” generalization What this means is that instead of making 
the over-all judgment of like or unlike on the basis of direct sense 
impressions (le, sensory generalization or “classification”), the sub- 
ject applies certain verbal terms to the blocks and then makes the 
classification on the basis of their similarity (or difference, see Dollard 
& Miller, 1950) 

Although there is much more to leasonmg and concept formation 
than indicated in this section (see, for example, Brunner, Goodnow, 
& Austin, 1956, Miller 8c Adurphy, 1956b), enough has been said to 
show how even these more complex psychological phenomena are 
analyzable in terms of principles developed in connection with the 
study of simpler phenomenon These principles are thus seen to have 
generality and power 
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IX Mathematical Reasoning and the Transposition Experiment 

It had been the writer’s original intention not to make any systematic 
reference in this book to the subject of mathematics But now (as the 
book goes to press) it seems desirable to alter this plan and to deal with 
this topic m at least a preliminary way As Chapters 3 and 4 indicate, 
we today have a very respectable psychology of language which 
stems directly from basic learning principles In Chapter 5 the psy- 
chology of meaning has been examined, and in Chapter 2, we have 
also rather intensively studied the phenomenon of mediation With 
this background, plus the material on insight and reasoning which 
have been reviewed in this chapter, it would seem natural to venture 
at least a little way into what may be called the psychology of mathe- 
matics Moreover, it has been the writer’s privilege m recent months 
to be associated, in a peripheral way, with the work of the Committee 
on School Mathematics, at the University of Illinois, and from this 
a number of new interests and hypotheses have emerged But it should 
be re-emphasized that what is said m this section is indeed preliminary 
and will leave many challenging questions quite untouched 

In the section on “Mediated Discrimination or Distinctiveness” in 
Chapter 2 of this volume, we have already seen how successfully 
Dollard and Miller (1950) have used the concept of response media- 
tion to explain the dramatic improvement in discrimination of multi- 
tude (and, in so-called measurement, or magmtude) which counting 
makes possible And there are many further applications of basic learn- 
ing principles which are fairly begging to be made to other aspects 
of what today is, rather happily, being called “number behavior ” But 
these are not our immediate concern Instead, we wish to proceed 
directly to some more intricate instances of number behavior which 
are particularly pertinent in a chapter such as the present one and 
which have the additional virtue of providing the occasion for at least 
brief allusion to a phenomenon, namely that of “transposition,” which 
IS not otherwise considered in this work 

How, then, to start? Perhaps the best way is to imagine Professor 
Max Beberman teaching a group of twelve-year-old boys and girls in 
one of his famous demonstration classes in mathematics On this par- 
ticular mormng he begins by asking the class to tell him at least two 
numbers which will “factor,” or divide into, the total for the ex- 
pression, (4 X 29) + (3 X 29) The children are encouraged to look 
for some “easy way” of finding the answer, instead of using pencil 
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and paper Various numbers are suggested by the class, and there is 
general discussion as to which ones are correct, but the instructor 
“plays dumb” and seems somewhat unsure about it all A few of the 
children think that 7 and 29 are the two correct numbers, but the rest 
of the class is uncertain and at a loss to know how these numbers were 
arrived at 

Dr Beberman then gives the following series of problems 

(1X5) +(2X5) 

(2X7) +(3X7) 

(2 X 13) + (i X 13) 

(3 X ii) + (2 X ii) 

(3 X4O + (8X4O 

(ii X 3O + (2 X 3O 
(9 X 43) + (2 X 43) 

By this time nearly all the class is able to give the two correct num- 
bers for each new “problem,” and the instructor asks them to “make 
up” other examples, for themselves He does not tell them any “rule” 
and the students are admonished not to announce any rule or “general 
principle” to each other By merely looking at example after example, 
they begin to ^^see what to do ” 

Obviously what is going on here, behaviorally, is a little complex, 
but there is at least an analogue to be found in a well known type of 
experiment, commonly carried out with ammals but sometimes also 
with very small children For our purposes a particularly illuminating 
example of this type of research is Margaret R Kuenne’s (1946) study 
on “The Relation of Language to Transposition Behavior in Young 
Children ” Her report begins thus 

The phenomenon of transposition in the discrimination behavior of ani- 
mals and young children has received a considerable amount of attention 
from psychological theorists The Gestalt psychologists, m particular, have 
made much of this ability of Ss to transfer a learned differential response, 
e g , a response to the larger of two stimuli, to a new combination of stimulus 
objects differing m the same property (eg, size), and they have cited it 
as conclusive evidence that the response was to the relative properties of 
the stimulus situation (p 471) 

^^For further discussion of this type of classroom activity, see Unit i of the 
Teachers’ Edition of High School Mathematics (Beberman, Vaughn, et al , 1959) 
Here we need only say that such activity is not aimed merely at providing “short- 
cuts” for certain types of computation, it helps lay a basis for the use of algebraic 
notation, set theory, and other important mathematical devices, as well as a lively 
set of attitudes toward mathematical activities m general (see end of this section) 
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Then, aftei a ie\iew of the most directly relevant literature, this 
author states the specific problem she pioposes to investigate as follows 

As a basis for an attempt to extend our understanding of discrimination 
beha\ior and the phenomenon of transposition in human Ss, the working 
hypothesis is here adopted that the mechanisms assumed by Spence [1937, 
see also Hilgard & Marquis, 1940, pp 188-194] to underlie this behavior in 
animals are also operative m the young child, and that with the development 
m older childreji of the capacity to employ verbal responses in such behavior 
situations, a shift occurs to the verbal type of control (p 474) 

The experimental procedure involved, first of all, allowing 44 children 
with mental ages ranging from three to six years to work to obtain a 
succession of small toys from one or the other of two adjacent boxes, 
w^hich could be rendered distinctive by placement of a square, white 
board (wath a surface of 68 o sq in ) on top of one box, with a similar 
though smaller board (37 8 sq in ) on the other one The smaller of the 
two squares \\ as the positive cue, indicating the box in which the toy, 
on any given trial, was to be found The box with the negative cue was 
locked As in a Lashley-type discrimination apparatus (used with rats), 
the positive and negative cues were randomly alternated with respect 
to the two (otherwise identical) boxes 

The subjects were then divided into two matched groups and, after 
the training just described, were ‘^tested in counter-balanced order 
with two pairs of still smaller stimuli (21 o vs 37 8 sq in , and 2 o vs 
3 6 sq in ) All spontaneous verbalizations of the size aspect of the 
stimuli were recorded throughout the experiment, and attempts were 
made at the conclusion, through questiomng, to elicit verbalization of 
the general principle of solution” (pp 488-489) What the investigator 
wished to see was whether the children, when given pairs of cues smaller 
than the original pair, would respond to the larger of the smaller pair, 
because it was more nearly the absolute size of the original positive 
(smaller) cue, or would react to the cues relatively, 1 e , to the smaller 
one of the pair, no matter what their absolute size might be 

Analysis of the results revealed a highly significant relationship between 
mental age and the occurrence of far transposition [involvmg the 2 0-3 6 
cues], and a low relationship between mental age and near transposition [the 
210-378 cues] The median number of responses on the far transposition 
test increased with age from 50 per cent at mental age three years to 100 per 
cent at six years The corresponding value for the near transposition test 
was 90 per cent or above at all four age levels (p 489) 

In other words, all the older children did about equally well in “trans- 
posing,” 1 e , were equally successful with both near and far transposi- 
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tions, whereas the younger children did decidedly bettei at transposing 
with the 210-378 cues than with the 2 0-3 6 cues Since verbal develop- 
ment was further advanced m the older children than in the younger 
ones, the original hypothesis was thus upheld “with the development 
in older children of the capacity to employ verbal responses m such 
behavior situations, a shift occurs to the verbal t>pe of control ” From 
other studies it is known that infrahuman subjects transpose much more 
easily when the test cues are similar to the original cues than w hen the 
test cues are very different Therefore, the performance of the small 
children m Kuenne’s experiment was quite similar to that of animals, 
whereas the older children — presumably because of their superior com- 
mand of language — were equally proficient m doth types of test 
At this point, many intriguing thoughts suggest themselves, only a 
few of which will be explored here It may be that animals and small 
children “transpose” successfully when the two cues are only slightly 
different from the original pair, in absolute terms, because the subjects 
do not perceive them as really “different ” In other words, the apparent 
transfer or generalization of the original discrimination training may 
occur so well because the subjects have no very clear way of remem- 
bering or conceptualizing (symbolizing) the absolute size of the stimu- 
lus objects (cf the problem of “absolute-pitch discrimination” in 
music), and hence do not perceive the test cues as different fiom the 
original cues But when the difference is flagrant, it becomes impossible 
for them to ignore the absolute difference, and subjects must then truly 
“transpose,” or else make serious errors of some sort Subjects who can 
say, “Oh, I know, it’s the smaller one that’s correct” (or something 
equivalent) would seem to have crucial advantage over those who can- 
not so verbalize In other words, they can now “transpose” or generalize 
much more widely, because a mediating response (“it’s the smaller 
one”) helps make the positive test stimulus now ^'more bke^^ the 
positive training stimulus (despite their “objective” difference), than 
they would be to “direct perception ” That is to say, the verbal 
mediator, or concept of “smaller-ness,” now provides the cue and tells 
the subject “what to do” (cf Weir & Stevenson, 1959) 

With the transposition paradigm before us, we can now advanta- 
geously return to the classroom example Success with this type of 
problem clearly involves a sort of “transposition,” 1 e , the finding of 
a kind of “similarity^^ between the various “examples” which does not 
depend upon the size of the specific numerical values involved Stu- 
dents must see, for one thing, that all the numbers involved in the an- 
swers are “primes” (capable of being divided only by themselves or by 
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one), and they must also see that one number is common to both pairs 
of numbers in the examples Then, eventually, they see that “7 and 29” 
IS the answer to the problem which was first presented because 29 is 
the common number and 4 and 3 make 7, 1 e , seven 29’s And seven 29’s 
(one doesn’t need to know what it comes to otherwise) must be divis- 
ible by both 29 and 7, and by no smaller numbers 

In order to solve an ordinary transposition problem successfully (at 
least w^here a “big” transposition is called for), the subject must, appar- 
ently, have or be able quickly to form the concept of larger-smaller 
and then to note that all stimulus pairs are alike in that one is larger, 
the other smaller — and that, in the experiment described, it is always 
the smaller that is the correct cue 

This analysis is obviously rough, but it suggests a rather broad con- 
tinuity between “mathematical reasoning” and basic learning principles 
a “discrimination” generalizes more widely if there is a mediator (com- 
mon element) which the subject can introduce in going from the orig- 
inal training situation to the test situation, wherein the “specific ele- 
ments” are different In other words, once you “get the principle” or 
“find the rule,” 1 e , find the common element or mediator, the solution 
(transposition, or transfer, of the “correct answer”) becomes easy 

There is, at the moment, a hvely controversy going on between 
mathematicians, or at least mathematics teachers, in the area under con- 
sideration The traditional assumption has been that, m keeping with the 
experimental findings of Kuenne, the capacity to verbalize or articulate 
“the rule” (1 e , find the common element, get the mediator) is not only 
helpful but essential in the development of mathematical skill and com- 
petence Hendrix (1947, 1950), on the other hand, has stressed the im- 
portance of “nonverbal awareness”, and Haslerud & Meyers (1958) 
have published what appears to be experimental support Verbalization, 
or formalization — particularly if it “comes too soon” (a phrase which, 
of course, somewhat begs the question) — ^is thus regarded as a hin- 
drance rather than an asset 

Although It is much too early to be confident on this score, the pres- 
ent writer is inclined to the view that the point of the method em- 
ployed by Beberman (and by a number of other investigators using 
somewhat similar approaches) hinges not so much upon the occurrence 
or nonoccurrence in the student of verbalization as upon certain simple, 
but often overlooked, motivational factors Certainly in terms of excite- 
ment and adventure, there is no comparison between a method which 
typically involves giving students a formal rule and then requiring 
them to “apply it” in the solution of routine exercises and a situation in 
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■u hich they are first confronted with the “examples” and encouraged 
(almost “dared”) to develop, or discover, “the rule” themselves The 
amount of secondary reinforcement experienced in the second situa- 
tion, other factois being anything like equal, would intuitively seem 
very much gi eater and the chance of spontaneous rehearsal and per- 
seveiation of “mathematical thinking” vould seem enormously en- 
hanced 

But, again, it should be stressed that the foregoing discussion is in- 
cluded here, not as necessarily providing final answers, but more as a 
means of showing that there ts common ground (“mediators”^) be- 
tween basic learning principles and “number behavior ” It is the writer’s 
prediction that in the years immediately ahead notable progress will 
be made in this general area, comparable to or perhaps even exceeding 
what we have already been able to point to with respect to the psy- 
chological analysis of word learning and sentence function (cf Newell, 
Shaw, & Simon, 1958b, Wertheimer, 1959) 

X Other Approaches to the Psychology of Thought 

Because scholars have long been interested in the psychology of 
thought, there is naturally an imposing literature on the subject, and 
if no cognizance were taken of it, the present treatment could justly 
be regarded as narrow and provincial Actually, some narrowness can 
be defended Here it is not our purpose to write a general treatise on 
the nature of thought or even to deal exhaustively with the relationship 
between thought and learning Rather are we concerned, primarily 
and specifically, with what revised two-factor learning theory has to 
suggest concerning this particular topic That assignment having been 
completed, albeit sketchily, at least a token attempt should be made to 
put this chapter into context as far as the more conventional literature 
on the subject is concerned 

In his Principles of Psychology (1890), William James included a 
chapter on “The Stream of Thought” which has been widely read and 
very influential Having in preceding chapters presented a point of 
view (largely derived from physiology) which foreshadowed Be- 
haviorism, James introduces his discussion of thought thus 

We now begin our study of the mind from within I use the word 
thinking, in accordance with what was said [earlier], for every form of 
consciousness mdiscrimmately If we could say in English “it thmks,” as we 
say “it rams” or “it blows,” we should be statmg the fact most simply and 
with the mmimum of assumption As we cannot, we must simply say that 
thought goes on (pp 224-225) 
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So far so good, says the modern reader, but then we find that the 
chapter is going to be divided into five parts dealing with the following 
propositions 

1 E\ erv thought tends to be a part of a personal consciousness 

2 Within each personal consciousness thought is always changing 

3 Within each personal consciousness thought is sensibly continuous 

4 It alwa}s appears to deal with objects independent of itself 

5 It IS interested in some parts of these objects to the exclusion of others, 
and welcomes or rejects — chooses from among them, m a word — all the 
while (p 225) 

And the full-scale development of these assertions is earned out in 
a way which leaves the modern reader “cold ” A psychology of thought 
which IS purely descriptive, in an introspective sense, cannot be saved 
from unspeakable dullness and futility, it seems, by even so lively a 
style as that of William James Only in a quotation from the biography 
of a congenitally deaf man, which bears upon “the question whether 
thought is possible without language” is the modern reader’s interest 
likely to pick up And even here interest is short-hved, for James 
makes nothing of the passage which articulates with contemporary 
theory except to say “The reader sees by this time that it makes little 
or no difference in what sort of mind-stuff, in what quality of imagery, 
his thinking goes on” (p 269) In other words, although the individual 
in question, as a boy, neither spoke nor wrote, he had a rich, varied, 
and essentially normal thought life and later, when he learned to read 
and write, was able to describe it with great clarity But then James 
lapses into a haze of obscurity and we soon lose him (or vice versa) as 
he goes on to say 

The only images intrinsically important are the halting-places, the sub- 
stantive conclusions, provisional or final, of the thought Throughout all the 
rest of the stream, the feelings of relation are everythmg, and the terms 
related almost naught These feelmgs of relations, these psychic overtones, 
halos, suffusions, or fringes about the terms, may be the same m very 
different systems of imagery (p 269) 

Published in 1906, J Mark Baldwin’s imposing three-volume work 
on Thought and Things represents a beginning of transition As the 
author remarks in his Preface, “The inroad of evolution and develop- 
mental theories, under the general notion of genesis, upon various 
‘preserves’ of the old disciphnes, is resulting in a certain obliteration 
of boundaries and readjustment of methods ” And Baldwin sigmficantly 
subtitles his work A Study of the Development and Meaning or 
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The mam task of this book is an explanation of the social processes in the 
genesis, integration, and functions of symbols There is an obvious need for 
such a systematic treatment, and a clearer statement of these processes (pp 
ix-x). 

There can be no denying that man is a social ammal and that much 
of mentality and experience is socially determined and socially oriented 
(see Chapter lo), but this is not to say that there are no propensities 
and capacities which are given by the very nature of an organism’s 
heredity and structure As we have seen, one of the difHculties which 
the implicit-speech theory of thought encounters is the fact that 
thought and speech are not stnctly co-extensive, animals, without 
speech, show clear indications of “thinking”, and there are similar 
difficulties if one makes thought completely contingent upon sociality 
Certainly we have no clear evidence that thinking as we see it in rats 
and apes is particularly dependent upon social experience or relation- 
ships For example, a rat reared in social isolation would seem just as 
likely to VTE at a choice point as one which had had extensive social 
experience Human speech and human sociality are, of course, in- 
timately connected, and there is no question that they influence both 
the content and the modes of human thought, but clearly, a general 
psychology of thought cannot be predicated upon either of them 
Thought, at least in its rudimentary forms, is a more primitive affair 

The more recent hterature on thinlang has been organized and 
evaluated in a volume by Johnson (1955), entitled The Psychology of 
Thought and Judgment This is a very large undertaking and it is re- 
ferred to here, not for purposes of review, but rather as a source which 
the reader may wish to consult in the original Of his own work 
Johnson says 

To anyone with a practical or theoretical interest m human beings the 
status of the psychology of thought is distressing Such fields of psychology 
as perception, learmng, and personality are bemg explored thoroughly and 
systematically But the scientific investigation of thmkmg is unsystematic 
and, m general, unsatisfactory 

Many psychologists express an interest in thmkmg, and some make raids 
on it The field is littered with disabled wisdoms cast off by hit-and-run 
theorists The purpose of the present work is to tidy up and remap this 
field, chartmg what is known and pushing a step or two ahead (p i) 

The prmcipal purpose of this book is an mtegration of present knowledge 
of the psychology of thought, aiming at breadth rather than the exploitation 
of any special theoretical approach (p 21) 

“For surveys of the field from other vantage points, see Blanchard (1940), 
keeper (1951), Rappaport (1951), Revesz et al (19^4), and Bartlett (1958) 
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How important man’s thought life is to him is indicated, not only 
by the extended liteiature and researches, but also by the following 
sentence which Johnson quotes from W P Montague “Man began 
to think in order that he might eat, now^ he has evolved to the point 
where he eats in order that he may think” (p 56) This evolution is 
truly momentous, and if we have m this chapter been mainly con- 
cerned with “thinking” as an adjunct to “eating,” it is not because w^e 
do not recogmze or appreciate the “higher,” more autonomous aspects 
of thought Instead our purpose has been to examine only those ac- 
tivities which can be legitimately included under this rubric and 
which, also, aiticulate fairly directly with our main theoretical con- 
cerns As learmng theory is refined and elaborated, it is hoped that the 
progression from the simpler processes which have here been explored 
to the more intricate ones, such as invention, logical problem solving, 
artistic creation, and dreaming will prove continuous and smooth 
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Learning Theory, Cybernetics, 
and the Concept of Consciousness 


Most psychologists of today have perfectly succeeded in developing a 
coherent science based on behaviour, taking no account of consciousness 
Is It not puzzling to encounter such negative attitudes at the time when 
neurosurgeons are beginning, so to speak, to “experiment” on consciousness 
and raise the question of its localization within the bram^ The recent multi- 
plication of symposia devoted to problems of consciousness is an expression 
of our present need, for scientific purposes, of a better understandmg of a 
phenomenon which is indeed the most mysterious in the whole universe 
(Fessard, 1954, p 201) 

The “negative attitudes” just mentioned are, as we know, deeply 
rooted historically The attempt to make a science of psychology by 
means of introspecuon, which occupied psychologists during the 
latter part of the nineteenth century, was a failure, and the movement 
known as Behaviorism stemmed directly from the attendant frustration 
and exasperation 

But m one respect Dr Fessard’s otherwise apt statement is in error 
Behaviorism has not produced a completely “coherent science ” Re- 
peatedly in this volume we have explored the blind alleys into which 
It has led us and from which we have found deliverance only by re- 
course to “intervening variables” and the concept of “feedback ” The 
time has now come to look more systematically at the implications of 
these developments and to relate them to collateral developments in 
other sciences and to human experience generally. 

252 
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1. Current interest in the Physical Correlates of Consciousness 

In Its ultimate sense, the phenomenon of consciousness is as mysteri- 
ous as hfe Itself, and no one seems to be very sanguine about the 
prospect of completely “explaining” it m the near future However, 
It can be studied, and it will be our purpose in this section to look at 
some of the fruits of recent investigation (see Footnote 17, p 292) 

As Magoun (1954) has observed, one important line of research has 
developed, opportunistically, from the fact that consciousness is peri- 
odically interrupted by sleep and from the “chance observation that 
direct electrical excitation of the reticular formation of the brain 
stem induces changes in the EEG seemingly identical with those ob- 
served m awakening from sleep, or alerting attention, and which have 
been referred to variously as activation, desynchronization, EEG 
arousal or the blocking reaction” (p 1) 

These findings quickly led to an experimental assault upon the 
brain area in question, with results which Magoun has summarized 
thus 

The great functional importance of this non-specific reticular system in 
the brain stem is indicated by the consequences of lesions in its cephalic 
part Monkeys with such experimental injury remained throughout survival 
in a comatose state, m which the absence of all behaviour associated with 
wakefulness contrasted sharply with the alertness and activity which this 
animal normally displays The EEG’s of such preparations were chronically 
hypersynchronous and could no longer be affected by peripheral stimuli, 
emphasizing the importance of collateral over direct corticipetal paths m 
EEG arousal induced by afferent stimulation Results in general similar to 
these have followed injury to the cephalic brain stem m the cat, and the 
findings are in good agreement with Bremer’s fundamental observations 
that transection of the upper brain stem leaves the cerebral hemisphere in 
a state of sleep, with which current mvestigations of this problem may be 
said to have begun (p 6) 

Naively, the conception of brain functioning has been that con- 
sciousness was pervasively “located” in the uppermost or cortical areas 
of this organ, where incoming messages from the sense organs were 
received and orders for bodily action issued Now the evidence is that, 
deep down in the brain stem, is an activating system which pours a 
stream of impulses into the cerebral hemispheres and “puts them to 
work ” During the emission of these impulses the organism is awake, 
conscious, and when they are inhibited, the organism is asleep, 
unconscious As a result of this view of the matter, the phenomenon 
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of sleep has taken on particular significance and is being investigated 
with renewed interest This function has been given special attention 
by W R Hess (1954), who prefaces his discussion with these remarks 

The more differentiated an organism, the more it depends on conscious 
elaboration of, and appropriate reaction to, signals from the external world 
in Its struggle for survnal During sleep these capacities are depressed and 
the mdividual is left defenseless The fact that all highly organized creatures 
accept this risk for a considerable part of their life suggests that sleep must 
have a vital function We consider it a reparative process which obviously 
cannot take place in the highest centres while they are active (p 117) 

Considering that the whole adaptive ‘'intelligence” of an organism is 
dependent upon the state of arousal 01 alertness known as conscious- 
ness, the periodic occurrence of sleep is indeed paradoxical, and only 
the most urgent of physiological considerations could have commanded 
such a sacrifice in the matter of security But be this as it may, the 
fact of sleep dramatically focuses our attention upon the reality of 
consciousness as something of great biological importance (and far 
from an epiphenomenon) and shows how unrealistic and deliberately 
self-restrictive any theoretical system is that ignores it Hess sum- 
marizes current thinking with respect to consciousness and sleep as 
follows 

The organism’s state of general excitability — ^which includes alertness and 
consciousness — ^is regulated by two antagonistic functional centres the 
ergotrophic centre which aims at maximal alertness and readiness for de- 
fensive or aggressive action, whenever such action is needed in the struggle 
for survival, and the trophotropic centre which mstigates mhibition of such 
activity, bring about sedation and eventually sleep, m order to preserve 
energy and allow tissues to recuperate From absolute prevalence of the 
former centre to maximal predommance of the latter, shades of intermediate 
states exist, such as relaxation, drowsiness, light sleep and so on, each linked 
to a corresponding level of consciousness These states are the result of a 
balance between the two antagonistic centres and conform to the needs of 
the environment (p 125) 

It should not be inferred, of course, that wakefulness and sleep cor- 
respond exactly to consciousness and unconsciousness The fact that a 
person is asleep is no guarantee that he is unconscious, as witnessed by 
the phenomenon of di earns And, conversely, the fact that an organism 
IS “awake” is no proof that he is conscious The latter point has been 
aptly made by Kleitman (1957) 

In the new-born mfant, or older anencephalous child, as m the decorti- 
cated dog or cat, the level of consciousness is close to, if not at, zero Their 
responses to stimuli do not meet the criteria for consciousness Yet they 
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show definite alternation of sleep and wakefulness In delirium, fugues, 
icteral or posticteral automation of psychomotor epilepsy, a person may be 
judged to be behaviorally awake, but his level of consciousness is very low, 
and he may have a complete amnesia of e\ents (p 358) 

In hypnosis the question of when the individual is asleep and when 
awake, when conscious and when unconscious becomes e\tremelv 
complicated Moieover, as will be shown in Section X, theie is reason 
to believe that, whereas the reticular formation (or “lymbic system”) 
is importantly involved in emotional learning, the cortex may be the 
“seat” of cogmtive learning (Chapter 5) This would square with the 
notion that an organism may be “aw^ake” and capable of affective re- 
actions without, however, really “knowing” anything, as is apparently 
the case in the “sham rage” of decorticated cats (see Bard, 1934) 
However, for many purposes, consciousness and wakefulness may be 
treated as synonymous, and the lately renewed interest in this gen- 
eral field has understandably stimulated much new research on anes- 
thetics and sedatives (see, for example, the review by Brazier, 1954), 
and psychologists (eg. Miller, 1958, Brady, 1957, Skinner, 1958a) have 
come forward with mgemous behavioral techniques for assaying their 
more subtle and distinctive effects The fact that those pathological 
states of consciousness (and unconsciousness) associated with Jack- 
soman epilepsy can often be remedied by brain surgery has opened 
up to Penfield and his associates the possibility of studying the effects 
of careful electric stimulation of the brain during such surgery They 
have been able to produce, in fully conscious patients (operated on 
under local anesthetic), elaborate “memories” (in various sense mo- 
dalities) which have more the qualities of images than of sensaaon, 
although to a limited extent they have also been able to produce 
“hallucinations ” Stimulation of the motor areas of the cortex produces 
an infinite variety of more or less intricate bodily movements, but, 
says Penfield (1954) 

When a motor area of the cortex is samulated, conscious patients do not 
believe that they have willed the action They recogmze mvariably that 
movement occurs mdependent of, or in spite of, their own vohtion (p 286) 

The integrating mechanisms prerequisite to voluntary planned action are 
subserved by to-and-fro cortico-subcortical neurone circuits 

There is a kind of fundamental dilemma in psychology in its efforts 
to be science If it attempts to take a “centrahst” position, 1 e , to focus 
upon brain and consciousness, its data are global and relatively un- 
analyzable On the other hand, if it attempts to take a “peripheralist” 
position, 1 e , focuses upon reflex arcs and specific stimulus-response 
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connections, its units of analysis become more manageable, but there 
IS the dangei that it will fore\er neglect those capacities for organized 
and integrated functioning that are so characteristic of living organisms 
As Konoiski (1958, see also jMowrer, i960, Chapter 7) has pointed 
out, Sherrington made a masterful study of the mammalian nervous 
system as far as its peripheral 1 espouse systems (reflexes) are con- 
cerned, but, despite the fact that his great w^ork was entitled The hi- 
tegiative Action of the Nervous System, Sheirmgton actually had very 
little to say about integration The researches cited in this section 
represent attempts to attack this aspect of the problem more directly, 
but consolidated knowledge is still meager and conceptualizations 
tentative 

In psychology proper, the opposition has been between the so-called 
S — R psychologists and those who have stressed cognition, organiza- 
tion, and Gestalt-like notions generally K S Lashley has repeatedly 
made statements such as the following 

Attempts to express cerebral function m terms of the concepts of the 
reflex arc, or of associated chains of neurons, seem to be doomed to failure 
because they start with the assumption of a static nervous system Every bit 
of evidence available indicates a dynamic, constantly active nervous system, 
or, rather, a composite of many interacting systems, which I have tried to 
illustrate at a primitive level of rhythm and the space coordinates Only 
when methods of analysis of such systems have been devised will there be 
progress toward understanding of the physiology of the cerebral cortex 

(1951.P 135) 

And Hebb (1949), among others, has called for renewed efforts to 
understand behavior m terms of the total brain rather than in terms 
of segmental stimulus-response pathways (cf James’, 1902, expression, 
“The Field of Consciousness” and Kohler & Wallach’s “Field Theory 
of Cortical Integration,” 1944, but see also Thomas & Stewart, 1957) 
While there can be no doubt — and this has been repeatedly docu- 
mented in this book — that the S — R bond is a greatly oversimplified 
abstraction and that we must not rest content with this level of analysis, 
the fact IS that the segmental, not the global, approach has yielded 
the more solid research findings and has grown in the more orderly 
and progressive manner 

This IS not to say that everyone should necessarily be working on 
the problem in the same way It is certainly useful to have some in- 
vestigators who are willing to adopt different perspectives and research 
strategies, but it is entirely possible that the segmental approach in 
psychology has been leading us toward a better understanding of the 
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organism-as-a-whole than we have fully realized At least this pre- 
sumption IS strengthened by a line of thought which will be followed 
in the next section and by recent developments in the area of physical 
automation, which will be considered presently 


II Representation and Consciousness 

It is one thing to agree that the Behaviorists were, in a sense, “wrong” 
in denying or ignoring consciousness, but it is something else again 
to find a truly fruitful way of studying this phenomenon psycho- 
logically The study of “consciousness per se” (or “conscious states”), 
by means of introspection, netted us very little (Mowrer, i960. Chap- 
ter i) In fact. It created a sort of scientific scandal 

The concept of consciousness still remains associated with one of the most 
traumatic experiences m the life history of scientific psychology, 1 e , intro- 
spectionism The wound has not yet healed, consciousness still means to 
many people a menace to behavioral science (Nuttin, 1955, p 349) ^ 

But the same writer then proceeds to make a case for consciousness 
which IS consistent with “behavioral science” and, quite specifically, 
with concepts developed in the present volume There is, he notes, a 
“representational theory of consciousness” which holds that external 
reality has an independent “existence” and that perception or con- 
sciousness serves to reproduce or represent this reality' on the mside 
of the orgamsm or individual 

The object perceived is considered only a representation or a duplicate 
of that unknown reality as it is supposed to exist in itself, independently of 
the behavmg subject From the behavioral or psychological viewpoint, 
however, there is no doubt that man perceives the thmgs themselves, that 
IS, the world itself Perception does not give him a representation of the 
world, but a direct presence of the world itself (p 350) 

The issues here involved seem somewhat philosophical, 1 e , without 
predictable consequences 01 testable implications, and therefore need 
not directly concern us here However, from them Nuttin moves on to 
a discussion of the utmost cogency to our present interests He says 

The problem of consciousness, however, becomes complicated by the 
fact that the world can be present to us m different ways Man is able to 
find himself m the presence of an object or a situation which is not im- 

^ Brown (1958b) makes the same point, even more graphically, when he says “In 
1913 John Watson mercifully closed the bloodshot inner eye of American psy- 
chology With great relief the profession trained its exteroceptors on the labora- 
tory animal” (p 93) 
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mediately presented to him from the outside This is what I call the vicarious 
presence of an object This possibility of vicarious presence of things to us, 
via images, concepts, and s\mbols, is a capital behavioral fact It enlarges 
to an enormous extent the world m \\ hich man is living and, consequently, 
the possibilities of behavior By this vicarious presence man’s dealing with 
situations goes far beyond the limits of respondmg to actually present 
things [cf Chapters 5 and 6] This inner, cognitive dealing with situa- 
tions is intrinsically directed to, or projected toward, an outside world and 
it IS, as a rule, preparatory or compensatory to effective external behavior 
(P 352) 

This, as Nuttin agrees, is also a “representational” view of conscious- 
ness, but the distinction is between the older view that a present re- 
ality IS re-presented perceptually or consciously and the view, just 
stated, that a reality which is not present perceptually can neverthe- 
less be represented, “via images, concepts, and symbols ” ^ The great 
and disastrous trouble with radical behaviorism was that it was so com- 
pletely ; 2 (? 72 representational, in Nuttin’s second sense of the term 
Rather obviously there was nothing representational about the Law of 
Effect, as conceived by Thorndike In fact, it was designed to provide 
a substitute for representational functions, as we have seen in the pre- 
ceding chapter In later sections of this chapter we shall find that the 
Law of Effect has potentialities for expansion in a direction which 
Thorndike seems not to have at all envisioned, but these aie not di- 
rectly relevant to our present discussion 

On the other hand, from the beginning, conditioning theoiy carried 
an imphcation of representatiomsm Pavlov himself (1927) stressed the 
fact that the conditioned stimulus or signal comes to stand for, or “rep- 
resent,” the unconditioned stimulus which, on earlier occasions, has 
followed the conditioned stimulus This representation is indicated by 
the fact that the subject responds to the CS as if it were the UnCS 
But here the representational function is all on the “stimulus side,” and 
It is only when we examine the subject’s responses, rather more care- 
fully that Pavlov did, that we begin to find representatiomsm m its 
most sigmficant form For Pavlov there was nothing particularly 
representative or symbolic about a conditioned response It was, in 
fact, exactly the same as the unconditioned response, the only differ- 
ence being that it was made to a different, formerly neutral stimulus 
But when we cease trying to be so inflexibly “objective,” we begin to 
see something of the utmost importance Perhaps the most salient 
feature of an emotion, as opposed to a behavioral reflex (in Pavlov’s 

-For a slightly earlier, and presumably independent, emphasis upon the role 
of representation m “cognitive processes,” see Scheerer (1953) 
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sense), is its representativeness for example, the emotion of fear gams 
Its special biological value from the fact that it can be expeiienced, 
not only in the absence of its adequate (unconditioned) stimulus, but 
also 'Without the 'pain (and biological danger) occasioned bv the latter 
In other words, the fear is a sort of primitive, but very powerful, 
repiesentation or “image” oj the pain, and hope, by the some token, 
IS an image of pleasure or gratification (cf Leeper, 1948) Hull and his 
followers originally tried to encompass these facts in the notation, r., 
or “anticipatory goal reaction ” But the notion was never very satis- 
factory because of its nonspecificity Hull, like Pavlov, v as trying to 
avoid recourse to anything so subjective as an emotion and, in con- 
sequence, threw up a quite unnecessary barrier to further progress 
But, as we have already seen (Mowrer, i960. Chapter ii), Amsel 
(1958), m dealing with the problem of extinction, has recently tran- 
scended this bias, and probably no one would today defend it very 
strongly 

Once the reality of emotion, as a sort of intermediary between the 
organism and the “real thing,” has been acknowledged, it is quickly 
discovered that emotions, of several kinds, can be conditioned to (a) 
external stimuli, giving rise to approach and avoidance behavior, and 
(b) to response-correlated stimuli, giving rise to response facilitation 
(habit) and inhibition More than this, in phenomena such as vicarious 
trial and error (Hull’s pure-stimulus acts), we see that living organisms 
sometimes perform actions solely because of their informative, cog- 
nitive, or feedback function, thus further enlarging our understanding 
of mediation and representation 

And, finally (in Chapteis 4 and 5), our analysis has forced upon us 
the necessity of recognizing representativeness in yet another form 
sensations, it seems, aie also conditionable and thus provide the basis 
for what may be termed images proper Here, as we have seen, is the 
basis for both memory and imagination, as they have been traditionally 
and popularly conceived 

Perhaps, in his emphasis upon representation. Professor Nuttin has 
not yet told us what consciousness is, but he has given us an excellent 
lead as to one of the things it does it enables us to function abstractly 
or, as Hull suggested, in the “not here and not now ” In an unconscious 
(sleeping) organism, such “mental life” is absent — or at least vastly re- 
duced (cf the dream) Later in this chapter we shall revert to this 
useful line of thought, but we have pursued it as far as practicable for 
the moment, and turn to what may at first seem to be an unrelated 
set of considerations 
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ill. Learning Theory and Servomechanisms 

Prodded on the one side by recent neurological findings (Section I) 
and, on the other by the inherent weaknesses of classical stimulus-re- 
sponse models (Section II), contemporary students of learning have 
been increasingly intrigued and challenged by those developments in 
engineering and machine design known as servotechnology or cyber- 
netics Campbell (1956b) has recently published a perceptive paper in 
this connection which will here serve as our point of departure (see 
also English, 1954) Campbell notes, first of all, that in the past efforts 
to conceptualize the phenomenon of “habit” have moved along two 
different lines “One of these is to define the response in terms of the 
body’s own coordinates, in terms of muscle contractions or move- 
ments The second alternative, equally operationally specifiable, has 
been to define the learned response in terms of a change in the rela- 
tionship between organisms and environment Responses defined in 
these terms become objective moves, places reached, regions entered, 
etc” (p 105) 

Here we at once recognize the distinction, previously noted 
(Mowrer, i960. Chapter 8), between so-called response learmng and 
place learning, and Campbell then points out that although the fact 
of place learning is indisputable, “the most popular and best developed 
learning theories have ignored this fact and have gone ahead assuming 
the adequacy of defining response in isolated motor or muscle terms” 
(P 105) 

A major reason for this resistance is that accepting the validity of the 
second definition of responses presents the learning theorist with a much 
more difficult problem, a problem which cannot readily be encompassed by 
the anatomically reinforced conceptualization of the simple reflex arc, with 
discrete afferent and efferent neural transmission pathways A second reason 
for resistance lies in the fact that those who, like Tolman (1932) and 
Lashley (1929), have pointed out the adaptive, object-consistent nature of 
learned responses, have not presented plausible mechanistic theories of how 
such responses could be achieved, and have used language implying purpose, 
thus raising the ghost of metaphysical issues which had been important at the 
time when psychology was freeing itself from philosophy Recent attention 
to the engineers’ achievement of self-regulating machines, the behavior of 
which is consistent to uniform ends achieved through variable mtermediate 
steps (as m the thermostat and governor at the most simple level and as in 
the aimmg and tracking devices for anti-aircraft artillery at a more compli- 
cated level), has supplied a mechanistic model of adaptive, habitual response 
mechanisms While we cannot say that adopting a steady state of homeo- 
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static model will solve at the psychological or physiological level the prob- 
lem of how such responses are achieved by the organism, it does at least 
give a deterministic model for facing squarely one of the toughest aspects of 
the actual phenomena of habit (p io6) 

Because of the implication of the passage just quoted and because 
repeated allusion has already been made in this book to similar con- 
cepts, It IS desirable at this juncture to develop a more explicit under- 
standing of just what is involved in the self-regulation achieved by the 
so-called servomechamsms No better survey of this field can be found 
than that provided by a small book recently published under the title, 
Automatic Co 7 itrol It consists of several brief and lucid articles which 
imtially appeared m the Scientific America?!, the first two of which are 
especially relevant for our immediate purposes One of these, entitled 
“Self-Regulation,” is by Ernest Nagel (1955a) and begins thus 

Automatic control is not a new thing m the world Self-regulative 
mechanisms are an inherent feature of innumerable processes in nature, liv- 
ing and nonliving Men have long recognized the existence of such mecha- 
nisms in living forms, although, to be sure, they have often mistaken auto- 
matic regulation for the operation of some conscious design or vital force 
Even the deliberate construction of self-regulating machmes is no innova- 
tion the history of such devices goes back at least several hundred years 

Nevertheless, the preacher’s weary cry that there is nothmg new under 
the sun is at best a fragment of the truth The general notion of automatic 
control may be ancient, but the formulation of its principles is a very recent 
achievement And the systematic exploitation of these principles — their 
subtle theoretical elaboration and far-reaching practical application — ^must 
be credited to the twentieth century When human intelligence is disci- 
plined by the analytical methods of modern science, and fortified by modern 
material resources and techniques, it can transform almost beyond recog- 
mtion the most familiar aspects of the physical and social scene There is 
surely a profound difference between a primitive recognition that some 
mechanisms are self-regulative while others are not, and the invention of an 
analytic theory which not only accounts for the gross facts but guides the 
construction of new types of systems (p 2) 

And the second article, by Arnold Tustin (1955), up the story 
and carries it on as follows 

For hundreds of years a few examples of true automatic control systems 
have been known A very early one was the arrangement on wmdmills of 
a device to keep their sails always facing into the wind It consisted simply 
of a mmiature windmill which could rotate the whole mill to face in any 
direction The small mill’s sails were at right angles to the mam ones, and 
whenever the latter faced in the wrong direction, the wind caught the 
small sails and rotated the mill to the correct position With steam power 
came other automatic mechanisms the engme-governor, and then the steer- 
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mg ser\o~engme on ships, which operated the rudder in correspondence 
\\ith movements of the helm These devices, and a few other such as simple 
\oltage regulators, constituted man’s achievement in automatic control up 
to about t\\ enty years ago 

In the past t\\ o decades necessity, in the form of mcreasmgly acute prob- 
lems arising in our e\er more complex technology, has given birth to new 
families of such devices Chemical plants needed regulators of temperature 
and flow, air w^arfare called for rapid and precise control of searchlights 
and anti-aircraft guns, radio required circuits which would give accurate 
amplification of signals 

Thus the modern science of automatic control has been fed by streams 
from many sources At first, it now seems surprismg to recall, no connection 
between these various developments was recognized Yet all control and 
regulating systems depend on common prmciples As soon as this was 
realized, progress became much more rapid Today the design of controls 
for a modern boiler or a guided missile, for example, is based largely on 
principles first developed m the design of radio amplifiers 

Indeed, studies of the behavior of automatic control systems give us new 
insight into a wide variety of happenmgs m nature and m human affairs 
The notions that engineers have evolved from these studies are useful aids 
in understanding how a man stands upright without toppling over, how 
the human heart beats, why our economic system suffers from slumps and 
booms, why the rabbit population m parts of Canada regularly fluctuates 
betw een scarcity and abundance 

The chief purpose of this essay is to make clear the common pattern that 
underlies all these and many other varied phenomena This common pattern 
IS the existence of feedback, or — to express the same thing rather more 
generally — interdependence 

We should not be able to hve at all, still less to design complex control 
systems, if we did not recognize that there are regularities m the relationship 
between events — ^what we call “cause and effect ” When the room is warmer, 
the thermometer on the wall reads higher We do not expect to make the 
room warmer by pushmg up the mercury m the thermometer But now 
consider the case when the instrument on the wall is not a simple ther- 
mometer but a thermostat, contrived so that as its reading goes above a 
chosen settmg, the fuel supply to the furnace is progressively reduced, and, 
conversely, as its reading falls below that setting, the fuel flow is increased 
This is an example of a familiar control system Not only does the readmg 
of the thermometer depend on the warmth of the room, but the warmth of 
the room also depends on the readmg of the thermometer The two quanti- 
ties are mterdependent Each is a cause, and each an effect, of the other In 
such cases we have a closed chain or sequence — ^what engmeers call a 
“closed loop” [Fig 7-1] 

In analyzing engmeermg and scientific problems it is very illummatmg to 
sketch out first the scheme of dependence and see how the various quantities 
involved in the problem are determmed by one another and by disturbances 
from outside the system Such a diagram enables one to tell at a glance 
whether a system is an open or a closed one This is an important dis- 
tinction, because a closed system possesses several significant properties Not 
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only can it act as a regulator, but it is capable of \ anous “self-e\citator} ” 
types of behavior — ^like a kitten chasing its own tail 

The now-popular name for this process is “feedback ’’ In the case of the 
thermostat, the thermometer’s mformation about the room temperature is 
fed back to open or close the valve, which in turn controls the temperature 
Not all automatic control systems are of the closed-loop type For example, 
one might put the thermometer outside in the open air, and connect it to 
work the fuel valve through a specially shaped cam, so that the outside 
temperature regulates the fuel flow In this open sequence system the room 
temperature has no effect, there is no feedback (Fig 7-1) The control 
compensates only that disturbance of room temperature caused by variation 
of the outdoor temperature Such a system is not necessarily a bad or useless 
system, it might work very well under some circumstances But it has tw o 
obvious shortcomings Firstly, it is a “calibrated” system, that is to say, its 
correct working would require careful preliminary testmg and special 
shaping of the cam to suit each particular application Secondly, it could 
not deal with any but standard conditions A day that was windy as well 
as cold would not get more fuel on that account 

Fig 7-1 Feedback loop (at bot- 
tom) contrasted with open control 
sequence (top) In a hypothetical 
heaung system, the outside temper- 
ature (To) might be employed to ( To j 
actuate the thermostat control 
(Th) on the furnace (F) to adjust 
room temperature (T) But there 
IS no provision for determining 
whether the room temperature has 
attained the level desired This self- 
regulating principle is uniquely 
provided by the feedback circuit 
Here the variable which is to be 
controlled, the room temperature. 

Itself actuates the thermostat It 
thus controls the performance of 
the furnace (Tustin, 1955, p 12) 

The feedback type of control avoids these shortcomings It goes directly 
to the quantity to be controlled, and it corrects indiscriminately for all 
kmds of disturbance Nor does it require calibration for each special 
condition 

Feedback control, unlike open-sequence control, can never work without 
some error, for the error is depended upon to bring about the correction 
The objective is to make the error as small as possible 

The principle of control by feedback is quite general The quantities 
that It may control are of the most varied binds, ranging from the fre- 
quency of a national electric-power grid to the degree of anesthesia of a 
patient under surgical operation Control is exercised by negative feedback. 
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uhich IS to say that the information fed back is the amount of departure 
from the desired condition (pp 10-14) ® 

The relevance of all this to our present concerns is clear Self- 
regulation has previously been regarded as one of the most important 
yet mystifying characteristics of living orgamsms Various global 
concepts such as “intelligence,” “consciousness,” and “knowledge” 
have been invoked as explanations, but not to good effect Radical be- 
haviorism was a movement of protest which was pointed in the right 
direction but, because of certain rigid, self-imposed limitations, was 
handicapped in what would otherwise have been its normal develop- 
ment Now, however, it has proved possible to construct machines with 
impressive capacity for 5e//-regulation, and since there can be no im- 
putation of “subjectivism” here, such machines and the principles they 
embody have inspired new attempts to account for the adaptive ca- 
pacities of living organisms along “objective” lines 

IV Law of Effect, Feedback, and ^'Knowledge of Results^' 

In one sense, the Law of Effect may be said to have postulated the 
principle of “feedback” long before the current interest in cybernetics 
It has held, from the beginning, that the consequences of a response, 
whether good or bad, act back upon that response (really upon the 
organism) in such a way as to increase or decrease the likelihood of 
Its future occurrence Through time, from “trial to trial,” the organ- 
ism’s behavior is thus automatically controlled, regulated, adapted in a 
way that is of the utmost importance to its continued existence (cf 
Hilgard, 1956, pp 4695) 

In Learning Theory and Behavior it has been shown (as was already 
sufficiently apparent from common experience) that if the “feedback” 
from a response is punishing, that response tends to be “weakened” 
(made less probable of future occurrence), whereas, if the feedback 
is rewarding, the response tends to be strengthened (made more prob- 
able of occurrence) In Chapter 10 it is shown, moreover, that if the 
feedback from a response — be that feedback either pumshmg or re- 
warding — ^is delayed rather than immediate, the rate and amount of 
learmng are correspondingly reduced And in Chapter 1 1 we have seen 
that learmng can be reversed, not only by the introduction of an op- 

®The term “inverse feedback” (McCulloch, 1951) seems preferable to “negative 
feedback” It imphes equally well that the system is error-actuated and does not 
conflict with the use of “positive” and “negaave” feedback in the sense of hopes 
and fears 
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posed type of reinforcement, but also (though more gradually) by the 
mere withdrawal of reinforcement These principles were all appreci- 
ated by Thorndike and are especially clear in situations where the 
consequences of a response are in the nature of primary reinforce- 
ments, decremental or incremental These principles are, of course, also 
easily demonstrable, particularly in human beings, when the reinforce- 
ments are derived, secondary 

It has been shown many times over (again by Thorndike— see be- 
low) that human subjects learn decidedly better with than without a 
“knowledge of results,” a fact which accentuates the principle of effect 
and minimizes the importance of such factors as “repetition,” “fre- 
quency,” “use,” and the like Under the heading of “Information and 
Effect,” McGeoch & Irion (1952) have a lucid discussion of this topic, 
wbch IS reproduced here 

In many studies of human learning, information (knowledge of results) 
has been the source of reinforcement Such information may be inherent 
in the learning task itself, as when the subject observes the results of his 
own behavior in the pursuit-meter situation, or the mformation may be 
given by the experimenter by means of some signal Usually, information 
depends upon past experience and transfer of training, since the subject 
must be able to interpret the informative cues The use of information also 
depends upon the subject’s motivation, at least to a certain extent Thus, the 
learner must want to make the correct response before the informative sig- 
nals of Right and Wrong can have much efficacy 

Information can vary in degree of specificity or precision In a repetition 
of one of Thorndike’s Ime-drawmg experiments (1927), Trowbridge and 
Cason (1932) have found that learnmg increases with increasing precision 
of the information given The subjects drew only three-inch lines, but drew 
them under four different conditions in a counterbalanced order The con- 
ditions were ( i ) the control, in which the experimenter said nothing after 
the drawing of each line, (2) a nonsense-syllable condition, in which the 
experimenter spoke a different nonsense syllable when the subject had fin- 
ished drawing each line, (3) a “right” and “wrong” condition, in which 
the experimenter announced Right or Wrong after each drawmg (as Thorn- 
dike had done), and (4) an exact information condition, in which the sub- 
ject was told the amount and direction of his error 

The major results may be seen [in Table 7-1] There is no learning 
under the control condition and none when a nonsense syllable is spoken 
after each line Announcement of Right or Wrong leads to a sharp reduc- 
tion of error, but exact information about the amount and direction of 
errors both minimized them early in practice and reduced them as practice 
went on The percentages of correct responses (not given in the table) for 
the four conditions are control, 13 6, nonsense-syllable, 5 i, Right-Wrong, 
226, and exact information, 54 8 These percentages corroborate the average 
error scores in demonstrating that increased precision of information about 
the results of responses is accomplished by mcreasing amounts of learning 
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This IS the usual result Without information, little or no learning results 
On the other hand, when information of results is given, learning occurs 
and becomes more efficient over wide limits as the precision of the useful 
information increases The more exact the information, the more exact can 
the standard become and the more precise may be the selection among re- 
sponses It may be questioned whether all information about the results 
of an act can "be excluded from a subject as complexly motivated as the 
human being Information concernmg the relation of an act to the experi- 
menter’s standard can be excluded, but the subject may still obtain some 
information about the relation of the act to a standard of his own In esti- 
mating the lengths of strips of paper without information from the experi- 
menter, he mav form an opinion about the accuracy of his estimate, which 
then functions as if it were information In drawing Imes he has kinaesthesis, 
on the basis of w hich he can estimate the relation of the Ime drawn to his 
own conceptual standard of the length of line he tried to draw Some of 
Thorndike’s (1932) results on line-drawing without formal information 
of results show^ an approach to a stable value which presumably represented 
the subject’s owm standard w^hich he approached with the aid of informal 
information available to him (pp 265-268, cf Seashore & Bavelas, 1941) 

TABLE 7-1 

Average Errors in Units of % Inch when Each Condition Appeared in the 
Initial Position of the Practice Order 

(From Trowbridge and Cason, 1932, p 253) 


Condition 


Groups of 
Trials 

Control 

Nonsense 

Right-Wrong 

Exact 

Information 

First 30 

5 97 

887 

7 33 

193 

Middle 40 

685 

00 

5 35 

I 12 

Last 30 

6 40 

00 

390 

97 


What, precisely, do these findings mean in terms of our present 
analysis? They show that actions may be influenced by their effects, 
not only when these effects take the form of primary rewards and 
punishments, but also when they take the form of mere “knowledge ” 
But this knowledge is not “purely cogmtive” it is an evaluative 
knowledge — a knowledge, so to say, of Good and Evil, of Right and 
Wrong And our earher discussions prepare us immediately to trans- 
form such “knowledge” into secondary reinforcements^ type-D and 
type-I 

What these observations come down to, ultimately, is this In order 
for responses to be facilitated or inhibited they have to be reinforced, 
positively or negatively, primarily or secondarily There must, that is 
to say, be a “feedback” of some sort, an experienced effect or conse- 
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quence But the particular type of feedback involved is a comparatively 
slow one, occurring only after a particular response is completed, and 
It is therefore capable of influencing only later actions Thus, as far as 
the organism’s total behavior is concerned, we are dealing with a 
closed-loop system, but as far as any particular action or response is 
concerned, the system is decidedly open Here, it seems, is one of the 
critical weaknesses in much earlier theorizing about the phenomenon 
of habit, a weakness which has been corrected in the current con- 
ception which stresses, not “bonds” or reflex “arcs,” but complete 
circuits which are constantly active while a given act is in progress 
This concept will be more explicitly considered in the next section 

V Revised Two-Factor Theory as a Cybernetic Analogue 

As just indicated, there is inherent in the Law of Effect a kind of 
feedback, or “servo,” principle But that principle, as postulated, is of 
such a nature as to influence or control, not a response as it occurs, 
but rather the response or behavior of the organism in the same (or a 
similar) situation on some future occasion The Law of Effect has often 
been criticized for making living orgamsms, at least per theory, “blind” 
and stupid They can, according to this law, adaptively modify their 
behavior after an action has occurred, and in this sense they are granted, 
by the law, a kind of intelligence But many observers insist that hving 
orgamsms also have the capacity to alter their actions while they are 
occurring and that this capacity dehvers them from the blind bumbling 
which the Law of Effect seems to demand of them As it turns out, 
in our attempt to discover how variation and control of a given re- 
sponse are achieved, we hit upon a new and apparently better way of 
explaining how it is that control, in the sense of alterations in sub- 
sequent behavior, is brought about, i e , what learning is and how it 
occurs 

As earlier sections of this chapter have shown, there is nothing 
radically new about either the concept, or indeed the application, of 
automatic control However, it remained for Norbert Wiener (1948) 
to suggest a colorful and inclusive term to cover a broad range of 
related phenomena in this area ^ and to point out a number of mterest- 

^ Says Wiener “We have decided to call the entire field of control and commu- 
nication theory, whether in the machine or in the ammal, by the name Cybernetics^ 
which we get from the Greek or steersman In choosing this term, we 

wish to recognize that the first significant paper on feed-back mechanisms is an 
article on go\ernors, which was published by Clerk Maxwell in 1868, and that gov- 
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mg parallels m nature The one of greatest use to us at the moment has 
been put m these words 

Now, suppose that I pick up a lead-pencil To do this I have to move 
certain muscles However, for all of us but a few expert anatomists, we 
do not know what these muscles are, and even among anatomists there 
are few if any who can perform the act by a conscious willmg m succes- 
sion of the contraction of each muscle concerned On the contrary, what 
we will is to pick the pencil up Once we have determmed on this, our mo- 
tion proceeds m such a way that we may say roughly that the amount by 
which the pencil is not yet picked up is decreased at each stage This part 
of the action is not in full consciousness 

To perform an action m such a manner, there must be a report to the 
nervous system, conscious or unconscious, of the amount by which we 
have failed to pick the pencil up at each mstance If we have our eye on 
the pencil, this report may be visual, at least m part, but it is more generally 
kinaesthetic, or to use a term now m vogue, proprioceptive If the proprio- 
ceptive sensations are wantmg, and we do not replace them by a visual or 
other substitute, we are unable to perform the act of pickmg up the pencil, 
and find ourselves in a state of what is known as ataxia An ataxia of this 
type IS familiar in the form of syphilis of the central nervous system known 
as tabes dorsalis, where the kmaesthetic sense conveyed by the spinal nerves 
IS more or less destroyed [cf Mowrer, i960, Chapter 7, Section VIII] 

However, an excessive feed-back is likely to be as serious a handicap to 
organized activity as a defective feed-back In view of this possibility, Mr 
Bigelow and myself approached Dr Rosenbleuth with a very specific ques- 
tion Is there any pathological condition m which the patient, m trying to 
perform some voluntary act like picking up a pencil, overshoots the mark, 
and goes mto an uncontrollable oscillation [as a too refined servomechanism 
does in “wild oscillation” or “huntmg”]? Dr Rosenbleuth immediately 
answered us that there is such a well-known condition, that it is called 
purpose tremor, and that it is often associated with injury to the cerebellum 

We thus found a most significant confirmation of our hypothesis con- 
cemmg the nature of at least some voluntary activity It will be noted that 
our pomt of view considerably transcended that current among neuro- 
physiologists The central nervous system no longer appears as a self- 
contamed organ, receiving mputs from the senses and dischargmg mto the 
muscles On the contrary, some of its most characteristic activities are ex- 
plicable only as circular processes, emergmg from the nervous system mto 
the muscles, and re-entermg the nervous system through the sense organs, 
whether they be proprioceptive or organs of the special senses This 
seemed to us to mark a new step m the study of that part of neurophysiol- 
ogy which concerns not solely the elementary process of nerves and synap- 
ses but the performance of the nervous system as an mtegrated whole (pp 
14-15) 


ernor is derived from a Latin corruption of We also wish to refer to the 

fact that the steering engines of a ship are indeed one of the earliest and best de- 
veloped forms of feed-back mechanisms” (p 19) 
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On later pages of his book, Wiener speaks of “learning,” “memory,” 
and the “conditioned reflex”, but he does not tie up these phenomena 
in any systematic way with the discussion just quoted The connection, 
if pursued, is basic and illuminating What the foregoing passages 
emphasize most pointedly is that the first “effect” of a bit of behavior 
on the part of living organisms is to stimulate, to inform, to feed back 
knowledge to the subject about the direction, extent, speed, and 
general nature of the behavior itself This we have called response- 
dependent stimulation There then follows a second, subsequent ejfect 
in the nature of success or failure of the behavior to satisfy the felt 
need or motive which originally prompted it It is, of course, this 
latter occurrence which Thorndike and other proponents of the Law^ 
of Effect have stressed — ^but stressed in such a way, or in such a con- 
text, as to cause the first type of ejfect to be largely neglected 

The reason for this neglect or oversight is obvious As we have seen 
in the first chapter of this book (see also Mowrer, i960), “habit,” as 
conceived by Thorndike, was merely a modifiable reflex, a “bond” or 
connection extending from some sense organ, straight through the 
organism, one may say, to the muscles involved in a particular pattern 
of movement And volition, consciousness, control had nothing to do 
with the situation This, of course, is the misconception w^hich the 
above quotation from Wiener so effectively corrects But Wiener’s 
analysis does not provide us, explicitly, with an alternative theory, 
although It points the way to such a theory 

In reverting to the fact that responses characteristically have tm- 
mediate and then somewhat later effects, one is reminded of the pos- 
sibility that the immediate effects of a response, 1 e , the proprioceptive 
and other sensory stimulation produced thereby, are in an ideal position 
to become conditioned stimidi for the detachable, conditionable com- 
ponents of the reactions elicited by the later effects, 1 e , the gains or 
losses, rewards or pumshments which result from the subject’s behavior 
in relation to the external world In other words, what Thorndike saw 
as the more or less exclusive effect of an action may be thought of as 
the unconditioned stimulus, some part of the reaction to which be- 
comes connected, through Pavlovian conditioning, to the first and most 
immediate “effects” of the reaction When we put what Thorndike saw 
together with the Wiener insight, we thus obtain a remarkably good 
theory (cf Miller, 1958) 

Such a theory, couched m the terms just used, may seem somewhat 
novel, but from the standpoint of common sense it is, again, “old hat ” 
What It says, in the more usual vernacular, is that “experience” shapes 
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our ‘‘expectations” and that our expectations then, in turn, control or 
govern our behavior If the objective and the subjective, the technical 
and the commonplace approaches to the psychology of learning thus 
merge and fuse, it can hardly be an occasion for regret 

As a result of his dismissal of conditioning as an unimportant if not, 
indeed, a nonexistent form of learning, Thorndike by-passed this 
possibility Because Pavlov, on the other hand, was only passingly in- 
terested in habit formation (see Mowrer, i960. Chapter 3), he also 
overlooked it While Hull came close to the conception, for reasons 
which are not entirely clear he, too, failed to develop its full potentiah- 
ties In some ways, Tolman, Lewin, and Freud were closer still, but 
they also only approximated this formulation Can it be that the 
cyberneticists have given us the clue to a truly powerful and umfying 
view of the matter^ 

VI Sluckin ond Ashby on Minds and Machines 

Not only have psychologists become interested in the newer types of 
self-regulatory machines, as possible models for an improved under- 
standing of mind, engineers, on the basis of the intelligence and ap- 
parent “purposiveness” of their machines, have also become interested 
in psychological problems But at once a difference has been apparent 
although machines have been built with remarkable capacities for self- 
regulation, they are not ordinarily able to lear?i Their intelligence is 
“wired in,” and they just go ahead doing, automatically, the often 
quite remarkable things they are supposed to Living organisms, by 
contrast, aie capable of developing, from “experience,” their own 
rules, goals, concepts, and ideas (Sinnott, 1952), and this is a feat 
which has fascinated and challenged the engineer 

In 1954 an English writer, W Sluckin, with traimng in both 
engineering and psychology, published a small book in which a number 
of automata, simulating living organisms, are briefly described Typical 
of the earlier machines of this kind is the one described by Sluckin as 
follows 

Some thirty years ago an interestmg httle toy enjoyed a good deal of 
popularity It was known as the mechanical “beetle ” When wound up, it 
could move on toothed wheels across a table The “beetle” was provided 
with a pair of “feelers,” one of which shd along the table top On reachmg 
the edge of the table, the slidmg feeler would drop, this would operate 
the toy’s mechanism in such a way that the beetle would change the direc- 
tion of Its movement to that parallel with the table edge It would again 
move on until on reaching the corner, it would change its direction once 
more, and so on The mechanism was quite simple The behaviour of the 
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“beetle” was no more complex than that of many other mechanical de- 
vices which respond automatically to certain signals, clues, or stimuli 

Sluckin then describes a number of “conditioned-reflex models” and 
“maze-runmng machines,” but the most serious attempt, to date, to 
construct a learmng machine has been made by Ashby and reported 
m his book. Design for a Brain (1952) Preliminary to his discussion 
of this apparatus, which he calls the “homeostat,” Ashby makes the 
following interesting observations 

The organism affects the environment, and the environment affects the 
organism such a system is said to have “feedback ” 

The same feature is shown by the example of the kitten and the 
fire The various stimuli from the fire, working through the nervous system, 
evoke some reaction from the kitten’s muscles, equally the kitten’s move- 
ments, by altermg the position of its body in relation to the fire, will cause 
changes to occur in the pattern of stimuli which falls on the kitten’s sense- 
organs The receptors therefore affect the muscle (by effects transmitted 
through the nervous system), and the muscles affect the receptors (by ef- 
fects transmitted through the environment) The action is two-way and the 
system possesses feedback 

The observation is not new 

“In most cases the change which induces a reaction is brought about by 
the organism’s own movements These cause a change in the relation of 
the organism to the environment to these changes the organism reacts 
The whole behavior of free-moving orgamsms is based on the principle 
that It IS the movements of the organism that have brought about stimula- 
tion ” (Jennings ) 

The good player of a quick ball game, the surgeon conducting an opera- 
tion, the physician arrivmg at a clinical decision — ^in each case there is the 
flow from signals interpreted to action carried out, back to further signals 
and on again to more action, up to the culmmatmg point of the achievement 
of the task ” (Bartlett ) 

“Organism and environment form a whole and must be viewed as such ” 
(Starlmg ) 

It is necessary to pomt to the existence of feedback m the relation be- 
tween the free-livmg organism and its environment because most physio- 
logical experiments are deliberately [done] with spinal reflexes, a stimulus 
is applied and the resulting movement recorded, but the movement is not 
allowed to influence the nature or duration of the stimulus The action 
between stimulus and movement is therefore one-way A similar absence 
of feedback is enfoiced in the Pavlovian experiments with conditioned 
reflexes the stimulus may evoke salivation, but the salivation has no effect 
on the nature or duration of the stimulus ® 

®Cf the example, cited earlier in this chapter, of a thermostat mounted on the 
outside of a house and connected to the furnace within 
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Such an absence of feedback is, of course, useful or even essential in the 
analytic study of the behaviour of a mechanism, whether animate or mam- 
mate But its^ usefulness m the laboratory should not obscure the fact that 
the free-livmg animal is not subject to these constraints 

Sometimes systems which seem at first sight to be one-way prove on 
closer exammation to have feedback Walkmg on a smooth pavement, for 
instance, seems to involve so little reference to the structures outside the 
body that the nervous system might seem to be producing its actions with- 
out reference to their effects Tabes dorsalis, however, prevents incoming 
sensory impulses from reaching the brain while leaving the outgomg motor 
impulses unaffected If walking were due simply to the outgoing motor im- 
pulses, the disease would cause no disturbance to walkmg In fact, it upsets 
the action severely, and demonstrates that the mcommg sensory impulses 
are really playing an essential, though hidden, part in the normal action 
(PP 3<5~38) 

Ashby discusses learning, which he exemplifies with his homeostat, 
under the heading of ultra-stability, and as background for that dis- 
cussion he introduces and defines the concept of stability By this he 
means essentially what others have called automatic control and 
homeostasis This is achieved by means of feedback, but feedback of 
a particular kind, namely negative or error-reducing feedback By 
contrast. 

Instability m such systems is shown by the development of a “runaway ” 
The least disturbance is magnified by its passage round the circuit so that it 
is incessantly built up into a larger and larger deviation from the resting 
state The phenomenon is identical with that referred to as a “vicious circle” 
(p 52 ) 

In order to sharpen this distinction, Ashby makes the following 
comparison 

The automatic pilot is a device which, amongst other actions, keeps the 
aeroplane horizontal It must therefore be connected to the ailerons m such 
a way that when the plane rolls to the right, its output must act on them 
so as to roll the plane to the left If properly jomed, the whole system 
IS stable and self-correctmg it can now fly safely through turbulent air, 
for though It will roll frequently, it will always come back to the level 
The homeostat, if joined m this way, would tend to do the same 

So far they show no difference, but connect the ailerons m reverse and 
compare them The automatic pilot would act, after a small disturbance, to 
increase the roll, and would persist m its wrong action to the very end 
The homeostat, however, would persist m its wrong action only until the 
increasing deviation made the step-functions start changing On the occur- 
rence of the first suitable new viue, the homeostat would act to stabilize 
instead of to overthrow, it would return the plane to the horizontal, and it 
would then be ordinarily self-correcting for disturbances 

There is therefore some justification for the name “ultra-stable”, for if 
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the mam variables are assembled so as to make their field unstable, the 
ultrastable system will change this field till it is stable The degree of sta- 
bility shown IS therefore of an order higher than that of the system with a 
single field (pp 99-100) 

There is thus inherent in Ashby’s discussion the useful distinction 
between what he calls stability y or mere homeostatic self-regulation 
(as manifested by many reflexive mechamsms and physical machines), 
and the concept of ultra-stability y which he equates to learmng Ashby’s 
further analysis of the latter phenomenon makes good reading, but, in 
the end, one feels that nothing very important has been added to our 
knowledge of learmng, except to show that learmng-like functions can 
be performed by machines There is, moreover, this fundamental over- 
sight It will be recalled, from Section IV of this chapter, that a kind 
of feedback is the distinguishing feature of the Law of Effect, but it is 
feedback from the environment (generally), after an act is completed, 
and not from the organism’s own receptors while the act is m progress 
Despite the excellent case which Ashby makes for feedback of the 
latter kind (see pp 270-271), when he comes to the hypothetical 
analysis of learning, he ignores the more immediate type of feedback 
and refers only to the remote “feedback” which is implied by the very 
term “effect” in the Law of Effect ® Like Sluckin’s analysis, previously 
cited, that of Ashby falls down precisely where one might expect it to 
make its most telling point These and other writers on cybernetics 
have apparently been so strongly influenced by traditional habit theory 
that, despite their expert understanding of feedback principles, they 
fall into the stereotyped pattern of thought about S — bonds as the 
basis of learning or unlearmng 

So striking and so puzzling is this oversight that one is moved to 
caution and doubt concerning the reasonableness of the alternative 
hypothesis which is fundamental to the present book If this hypothesis 
is sound, It would seem likely that it would have been independently 
articulated by various writers, and particularly by those with concerns 
jointly covering cybernetics and learning However, at least a cursory 
survey of the available literature (Jeffress, 1951, von Foerster, 1950, 
1953) gives no lead to any parallel statement, a fact that certainly 
should suggest more than the usual degree of tentativeness in advocat- 
ing or accepting such a view 

®This IS all the more puzzling because the passage from Bartlett, which was 
quoted by Ashby (p 271), obviously refers to feedback of the first rather than 
of the second kind 
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Vn Can Feedback and Representation Be Combined^ 

In this chapter we have now examined two quite different approaches 
to those complex, highly orgamzed activities which are subsumed 
under the concept of consciousness Following the suggestion of Nut- 
tin, we have explored the notion that what he calls “representation” 
lies at the heart of such activities, and we have also reviewed the basic 
principles which are incorporated in those self-regulatory machines 
which most nearly approximate the higher (mental) capacities of hving 
orgamsms The question we must now consider is whether these two 
approaches are essentially independent, perhaps even inconsistent, or 
whether they are capable of being combined into a still more powerful 
and comprehensive conceptual model This is a question whose answer- 
ing calls for specialized competence which is beyond that of the present 
writer, but it is our good fortune that a research team, consisting of 
W T Powers, R L McFarland, and R K Clark (1957), of the 
Chicago VA Research Hospital, have tackled precisely ttus problem 
and have kindly made available an advance copy of a paper entitled 
“A General Feedback Theory of Human Behavior” in which they give 
the results of some years of thought and experimentation ^ Despite its 
highly synoptic style, this paper runs to fifty typescript pages and 
obviously cannot be substantively summarized in the course of a few 
pages What can be done — ^and for our purposes will suffice — ^is to 
describe the strategy of the authors’ efforts and the direction in which 
they are attempang to move 

These writers begin by remarking 

To those readers already well-acquainted with electronic feedback theory 
we can state the essence of what we have to present here in a few words we 
have observed that human feedback systems can be governed by control of 
their reference-levels Using this insight we have found it possible to build 
up a hierarchical assembly of feedback systems m which control is accom- 
plished thru a higher system’s setting the reference-levels for lower sys- 
tems These concepts appear to constitute a new orgamzmg principle for 
psychology We hope that this may be one of the results which many peo- 
ple have been seeking smce the birth of cybernetics (p i ) 

Much is being said or imphed here which becomes fully compre- 
hensible only as one reads on into the Powers-McFarland-Clark paper, 
but the general notion which the writers wish to present will be clear 

^ For an account of somewhat similar enterprises, see Fairbanks (1954), Jacobson 
(1955), J G Miller (1955), and Osgood (1957) 
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to the reader if only one “translation” is made Latei in the paper it 
becomes apparent that by “reference-levels” the writers mean some- 
thing very similar to what Nuttin refeis to as the rep 7 esentatiojj 
function and to what we have denoted by such teims as image, medi- 
ator, and (perhaps) emotion (see also Fairbanks’ notion of a “compara- 
tor,” 1954) Thus the integration of feedback theory and the concept 
of representation becomes an explicit objective The writers continue 
their introductory remarks as follows 

What our model will do, we hope, is to make such diverse points of 
view make sense in terms of each other, in other words, we consider our 
model to be first of all an organizing principle, an overall description of 
human organization, that may lead to some of the basic theory that has 
been lacking in behavioral science for so long Such a statement may seem 
somewhat immodest let us add that none of the authors has any illusions 
about the sources of our ideas We have only attempted to organize what 
has been done by others (p 2) 

The authors then pursue their analysis by obseivmg that 

Feedback concepts have been used m behavioral theories for (literally) 
centuries, in the form of various “self-correcting” aspects of psychological 
models The concept that all behavior is designed to minimize stimuli [error 
activation, in cybernetic terms] is an elementary feedback idea, as is the 
concept of homeostasis as applied to the human system by Cannon (p 3) 

However, before such general notions can be maximally useful they 
must be exemplified in more specific detail, and it is here that the real 
difficulty is encountered Those machines which are capable of the 
most strikingly “intelligent” performances are, of course, the giant 
computers, of which there are two piincipal varieties digital com- 
puters and analogue computers Since the former operate electrically 
(by means of relays) 01 electiomcally (by means of vacuum tubes or 
transistors) and are usually both more accurate and more rapid than 
the latter (which, in the typical instance, operate on some mechamcal 
principle), the tendency has been to take the digital computer as the 
model for mental operations (cf , for example. Von Neumann, 1958, 
Newell, Shaw, & Simon, 1957, ^ 95 ^) despite ingemous attempts 
to hken the laws of neuronic action to digital-computation principles 
(see, eg, McCulloch & Pitts, 1948), the would-be umon has not been 
a happy or fruitful one, and Powers, McFarland, and Clark are well 
advised in their selection to the analogue computer as their model 
They say 

An analogue computer is inherently less precise than a digital computer, 
because instead of relying on counting techniques (which can be carried 
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to any desired degree of accurac}^ ) based on exact equations, it depends on 
setting up a system whose properties are analogous to the properties of the 
equation or the physical system under study But fortunately the analogue 
computer has several great advantages over the digital computer as far as 
our use of it is concerned it provides a technique for representmg a system 
m terms of its junctions, which need be defined only as the problem re- 
quires, and in terms of the signals which are handled by these functions 
It gives us a representation of relationships withm the system under study 
such that we can often get an intuitive grasp of the system’s operation 
Giv en a system which can validly be looked upon as an analogue computer, 
the feedback concepts inherent in this approach make it possible to make 
moderately precise predictions of the behavior of the whole system Per- 
haps one final advantage of the analogue techniques should be mentioned 
to analyze the organization of human behavior in this way requires only a 
knowledge of the junctions performed by the person, whereas the digital 
approach as exemplified m cybernetics demands ultimately a complete 
knowledge of the structure of the nervous system, neurone by neurone Of 
course the digital techniques can be “smoothed” so that they come to re- 
semble analogue techniques, and may eventually lead to more precise and 
complete knowledge, but at the moment even moderately precise knowl- 
edge more easily gamed has an essential place in our study of behavior 
(PP 5-^) 

When one comes to think of it, analogy and representation are strik- 
ingly similar concepts both imply a likeness between two different 
objects, events, or processes Thus, we can say, readily enough, that 
fear is the analogue of pain and still mean that the pain is represented, 
functionally, by the fear The very term image implies an analogy or 
hkeness, and in order for one event to iriediate another, there must in 
some sense be an equivalence ® Thus, by the happy choice of the in 
some ways “inferior” analogue computer as their conceptual model. 
Powers, AlcFarland, and Clark avoid what, thus far, has been a blind 
alley for others But even here they are quick to acknowledge the 
priority of others They note that Ashby’s Homeostat also functions 
on the analogue rather than the digital principle, but their approach 
differs from that of Ashby in the following ways 

The fundamental difference between our approach and Ashby’s is in the 
“tightness” of feedback control involved m our model Whereas Ashby 
conceives of human systems as bemg rather slow-actmg and compliant to 
external forces, we conceive of the opposite, that most human feedback 
systems stay very close to the “restmg state,” and that small deviations re- 
sult in immediate and strong corrections, thus rendermg direct environ- 
mental forces relatively ineffectual except under extreme circumstances 
Behavior, then, we say results from an alteration of the resting state v/ithin 

®This equnalence may be either inherent or arbitrary In the latter case we 
speak of coding 
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the limits of a variable beha\ioral field, and that this alteration takes place 
as a result of information recevied by the organism When the organism 
IS driven past the limits of its abilities to maintain the prescribed momentary 
restmg states, v^e assume with Ashby that some adaptive change m the 
system must occur However we do not insist that the adapting function 
be random, our treatment of an organizing function allows for the possi- 
bility that the chief factor may be random, but we redefine “random” in 
relativistic terms (pp 7-8) 

It IS evident that at this point the argument is becoming involved and 
techmcal to a degree which makes it impractical to try to follow it, 
in detail, but one aspect thereof deserves special notice 

There is implied in all feedback systems a reference-level for the feed- 
back signal, such that if the feedback signal moves above or below this level, 
the deviation is corrected Therefore we mtroduce [into our conceptual 
system] a signal which carries the information defining this reference-level, 
and call it the Reference-Signal Thus the Output Function acts on the 
difference between the Feedback and Reference-Signals, not on the Feed- 
back Signal alone It acts to keep this difference small Since the Output 
Function must act on a signal much smaller than either the Reference or 
Feedback Signal, it must be sufficiendy sensitive to produce a large Output 
Signal on the basis of a relatively small difference between Reference and 
Feedback Signals (pp lo-ii) 

Here the reader will at once be reminded of many earlier allusions to 
this principle For example, in Chapter 12 of Learning Theory and Be- 
havior, the phenomenon of skill is analyzed m terms, not of “motoi” 
fitness or refinements, but of highly trained discriminations^ between 
the feedback from actual performance of an activity and a standard of 
performance which has already (by example, instruction, or past ex- 
perience) been estabhshed The parallelism to Feedback Signals and 
Reference Signals, as used by the authois cited, will be evident 

Or, take the case of the autism theory of w^ord learmng (Chapter 3) 
Here it is assumed that a human infant or “talking” bird becomes able 
to say a word by virtue of the fact that he already “knows” what it 
sounds like and can practice the response against the model which al- 
ready exists (in memory or “imagination”) 

These, of course, are not isolated or unusual examples they typify 
the general conception of response selection and performance which is 
basic to our analysis as a whole, and it is believed that this conception 
IS strikingly congruent with the theoretical model elaborated by 
Powers et al In concluding, these wTiters say that their next concern 
will be in “relating feedback theory to other theories of human be- 
havior, and to that end our next papers will be directed” (p 50) It 
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IS hoped that, in those papers, they too w ill see this same congruence 
But, in any event, their approach is off to a good start empirically m 
that It has enabled these investigators to devise (or suggest) a number 
of practical procedures or experiments, of which the following is 
representative 

The analysis of the first four orders of control may prove to be a very 
useful clinical tool, it has been pointed out that clonus oscillations and the 
oscillations seen m certain neural disorders are at a frequency we would 
assign to the first-order systems By our method of artificially unstabilizing 
the control-systems by use of negative dampmg, we can emphasize tenden- 
cies to oscillations before they might otherwise become clinically notice- 
able (p 48) 

The system obviously has “power” and we may look forward to its 
further development and apphcation with high expectation ^ 

Vni Some Guideposfs to Research 

The present section was part of a preliminary draft of this chapter 
which was written before the work of Powers, McFarland, and Clark 
had come to the author’s attention It therefore made no allusion to 

®The writer is indebted for a recent letter from Dr Clark who, with his col- 
leagues, has been good enough to read a manuscript copy of this chapter While 
expressing general agreement with the present analysis. Dr Clark suggests this 
refinement in the interpretation of the Powers-McFarland-Clark system ‘The 
concept of ‘reference-lever is based on the way mformation is used in a feedback 
system rather than on what variables this information represents Whenever any 
kind of ‘stored’ mformation functions to determine the equilibrium state of the 
feedback system (remember that this means the reference level to which that sys- 
tem brings Its inpm information), we refer to it as the reference-signal We have 
formally postulated that these reference-signals are replayed recordings of past 
feedback (input) signals, and so are quite properly considered as memories or 
‘images’ In this sense, our ‘reference-signal’ is what Nuttin calls a ‘vicarious 
presence’ of perception, but we differ sharply from him in that we suppose that 
the system’s input signals are also ‘representations’ of environmental variables, and 
are not at all those variables themselves (We find it rather hard to imagine how 
the nervous system can perceive anything until it is represented by a neural 
signal ) ” The notion that performance represents an attempt to match a standard 
or “reference level” of some sort can be gnen greater generality, and familiarity, 
by recalhng the Lewmian notions, already widely current in psychological litera- 
ture, of “level of aspiration” and “performance level” and the Freudian concepts 
of ego and superego In sociology there is also the notion of actual behavior and 
“ideal pattern” or “role expectation” Discrepancy between the ideal and the 
actual, in aU these systems, is assumed to be motivating and self-correctmg For 
a somewhat similar attack upon this type of problem, see Jacobson (1955) 
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Reference Signals and Feedback Signals, as Powers et cil employ these 
terms, but it now develops that this section nevertheless provides two 
rather dramatic instances of their applicabilitv In the first procedure 
here described, w e are obviously dealing w ith a situation in w hich 
the Reference Signals aie maintained intact but where the Feedback 
Signals which would normally be operative are excluded Thus all 
basis for comparison (the authors cited speak of a Comparator Func- 
tion, pp 1 1 ff ) IS eliminated, and it is not surprising that performance 
(presumptively) becomes chaotic (see also Fairbanks, 1954) 

In the second set of observations reported we have the interest- 
ing situation where two different sources of sensory feedback, w hich 
ordinarily vary together in an orderly, predictable w’ay, are rendered 
incompatible and discordant (see also Riggs et al ^ 1953) Here, too, 
are possibilities for further research (which are at least in part antici- 
pated by the reference of Powers et al to the phenomenon of conflict in 
their system) 

With this preamble, the section follow^s, very much as originally 
written 

When the author recently made a summary presentation of the 
revised two-factor interpretation of learmng at a neighboring uni- 
versity, a question w as asked w hich went as f ollow^s 

You posit that “habit” is — or at least may be — entirely a matter of the 
meanings that get associated with response-correlated stimuli, and from 
this It follows that if all such stimuli could be eliminated the “habit” would 
automatically be shorn of its “strength” Isn’t such reasoning somewhat 
academic^ For if you eliminate all the response-correlated stimuli or sensory 
“feedback,” you iso eliminate the stimuli that initiate the response 

For example, take a rat m a Skmner box Some of the stimuli which are 
correlated with bar pressmg on the part of the rat are visual, 1 e , the rat 
sees his paw as he places it on the bar and this constitutes a part of the 
feedback on which you assume habit strength depends But you can’t elimi- 
nate the rat’s view of his paw, for experimental purposes, without also 
eliminating his view of the bar as well x\nd if the rat can’t see the bar, 
then, of course, one wouldn’t expect him to try to press it, no matter how 
strongly instigated he might be to press it when the bar was normally 
visible 

This IS a good argument and one for which no adequate rejoinder 
was immediately forthcoming However, a few days later the writer 
remembered an appaiatus note, entitled, “A Device for Studying Eye- 
Hand Coordination without Visual Guidance,” which was published 
more than twenty-five years ago (Mowrer, 1935) The following para- 
graphs are quoted therefrom 



280 


LEARNING THEORY AND THE SYMBOLIC PROCESSES 


In the manual localization or manipulation of a seen object, three distmct 
stimulus-factors are ordinarily mvolved (i) visual stimulation from the 
object, (2) visual stimulation from the hand and arm, and (3) kinaesthetic 
(at times also cutaneous) stimulation from the hand and arm An analysis 
of the extent to which each of these three factors contributes to the de- 
velopment and efficient performance of eye-hand reactions is of consider- 
able importance It is obvious, however, that neither the second nor the 
third factor can be studied in isolation from the first, for with the elimi- 
nation of vision of the object, reactions made to it cease to be eye-hand re- 
actions In Ss m whom the kmaesthetic (and cutaneous) sensitivity of the 
hand and arm is absent, either as a result of neural lesion or local anaes- 
thetization, the first and second simulus factors may simultaneously be stud- 
ied, independently of the third (Lashley, 1917) But so far as the writer 
is aware no entirely satisfactory method has previously been devised for 
eliminating the second factor (visual stimulation from the hand and arm) 
m such a manner as to make possible the study of eye-hand reactions with 

Fig 7-2 Diagram of apparatus 
for testing eye-hand co-ordina- 
non without visual guidance 
The diagonal partition (X-Y) 
consists of a plain mirror so sit- 
uated as to cause the reflected 
image of the top of the upper 
compartment, as seen by subject 
through the indicated aperture, 
to appear in the position occu- 
pied by the back of the lower 
compartment The lower com- 
partment has no floor, and the 
central area of the front, below 
the shelf supporting the mirror, 
IS also open, so that the subject, 
by extending his arm, can easily 
touch the back of the apparatus 
and reproduce, by drawing, the 
figure projected there from the 
top of the apparatus 

only the first and third (or only the first) factor operative The appara- 
tus here described [see Fig 7-2] was constructed with this end in view 
The apparatus should be found useful not only as a means of ex- 

“ Direct vision of the hand and arm is usually eliminated in mirror-drawing 
experiments, but the hand and arm can alw^ays be seen in the mirror (for illustra- 
tion see G M Whipple, 1915, p 122) In the Miles two-story maze all vision of 
the hand and arm is effectively eliminated, but the seen (top) maze is not spatially 
congruent with the explored (bottom) maze For illustration of Miles’ apparatus 
see W Miles, 1927, p 369, also C M Cox, 1928, facing p 542 
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plormg and demonstrating the role of visual guidance in the eye-hand co- 
ordination of adults, but also as a means of studying the development of 
this type of response in children It may likev. ise facilitate the mvestigation 
of the effect of various positions of the eyes and head upon the tonus of 
the extremities Again, it may be employed m the clmical diagnosis of 
certain subtle disorders of coordination (notably those arising from im- 
paired kinaesthetic sensitivity) As an instrument for studymg the effects of 
practice without knowledge of results its utility is obvious Finally, by 
usmg Ss in whom the kinaesthetic sensitivity of the hand and arm is re- 
duced or lacking, it should be possible with this apparatus to study eye- 
hand coordination at its simplest level, le, with vision of the object as the 
only stimulus-factor, such an investigation should provide significant m- 
formaaon regarding the fundamental character of spatio-motor mtegration 
(PP 493-495) 

The excerpts just quoted were written well in advance of the 
cybernetics vogue, and even before the second version of two-factor 
learning theory had been clearly articulated by anyone Nevertheless, 
they seem to offer a good way of demonstrating the role of informa- 
tion “feedback” in so-called habit In Chapter 7 of Learjimg Theory 
and Behavior we have seen the effects upon speech that are produced 
by slightly delaying auditory feedback In the apparatus just described, 
It is possible, in the case of eye-hand coordinations, or “habits,” to 
eliminate visual feedback without interfering with the visual field m 
which the action is to occur, and, by means of afferant nerve blocks, 
It should be possible to eliminate all cutaneous and proprioceptive 
backlash as well, thus leaving, presumably, no feedback at all At least 
one physiological psychologist, to whom the question has been put, 
has confidently predicted that, under the conditions described, “per- 
formance would go completely to pot ” 

If “habit” IS a matter of stimulus-response bonds, of the kind postu- 
lated by Thorndike and later imphcitly assumed by Hull (see Chapter 
i), then, given proper motivation and the visual field in the above 
example, established “habits” ought to run off smoothly enough Such 
does not seem at all likely to occur However, research rather than 
argument is what we need here most urgently (cf Slack, 1955) 

In the apparatus note just alluded to, the strategy for showing the 
role of feedback in habit involves the elimination of one or more 
modalities of information Let us now ask what happens if two modali- 
ties of feedback, which are normally congruent, are rendered incon- 
gruent In postural and locomotor “habits,” gravitational and visual 
cues are normally anchored in a relatively invariant manner Because 
both stationary and moving objects m our environment have to main- 
tain certain characteristic positions if they are to preserve their “bal- 
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ance,” w e are accustomed to certain visual stimuli, e g , the vertical 
lines of buildings, being parallel to the direction of gravity as it im- 
pinges upon our bodies Therefore, one wondeis what happens under 
those relatively abnormal circumstances where theie is a discrepancy 
between visual and gravitational cues Such a discrepancy may be 
noted, in a limited w ay, as one rounds a curve on a tram, but a much 
more dramatic and instructive instance has been reported by Gibson 
& Mowrer (1938) 

A striking opportunity to observe the influence of centrifugal force 
upon the perception of the veracal (and one which, so far as the writers 
are aware, has not previously been taken advantage of) is that afforded by 
the so-called “motordrome,” where vehicles travel around the inside wall of 
a large vertical cylinder 

In order to obtam some notion concerning the sensory impressions of 
persons who perform m these motordromes, one of the writers has ques- 
tioned several such persons and on two occasions has accompanied one of 
them In a “drome” with a diameter of 40 feet, a motorcycle traveling 
around the vertical sidewall at a speed of 35 mp h is acted upon by a hori- 
zontal centrifugal force equal to approximately 3 9 times gravity Naturally 
one’s “weight” under such conditions is relatively tremendous, the task of 
lifting a hand (which feels as if it might be made of lead) involves exorbi- 
tant effort At still greater speeds the blood is centrifuged from the head, 
with ensuing cerebral enemia and loss of consciousness, the occurrence of 
which IS presaged by what the riders refer to as “going blind ” Following 
a ride m a motordrome there is also an interesting form of postrotational 
nystagmus which, however, cannot be pertinently discussed here 

Without exception performers in a motordrome report the feeling that 
they are riding in a virtually upright position, with the motordrome lying 
on Its side and rolling along barrel-fashion The actually vertical wall of 
the motordrome ‘beneath’ them is perfectly horizontal Therefore, since 
the vector resultant formed by centrifugal force and gravity is not quite 
perpendicular to the wall of the motordrome (deviating about 14° at a 
speed of 35 mp h in a “drome” of the size indicated), a motorcycle rider 
will feel that he is tilted slightly away from his perceived vertical, which is 
perpendicular to the wall Experienced riders learn to accept this unnatural 
position, but for the neophyte it is extremely disconcerting, causmg him 
continually to be trying to “straighten up” (1 e , sit in an actually horizontal 
position) which of course mterferes with the balancing of the motorcycle 

On the first occasion when the writer accompanied a professional rider in 
a motordrome, the only describable experience was one of complete spatial 
disorientation Movement was clearly perceptible but it was impossible to 
give It any definite directional reference It was as if a complexly integrated 
perceptual mechanism had completely broken down, and this, we conjec- 
ture, is precisely what had happened Visual and postural factors were 
thrown into such violent conflict that no stable perceptual organization 
could emerge However, on the occasion of the second ride (which oc- 
curred only a few minutes after the first), this confusion disappeared, and 
the spatial illusion by veteran riders was vividly experienced 
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Here it is significant to note that although this illusion, that the motor- 
drome IS lying on its side and revolving in this position, clearly reveals the 
predominance of what we have called gravitational factors over visual fac- 
tors, nevertheless visual factors exert some influence on the perceived ver- 
tical If the g-factors were the sole determinants in this situation the 
rider’s apparent vertical would deviate just 76° from the real vertical, 
coinciding with the vector resultant As it is, the rider’s vertical deviates 
90° from the real vertical, presumably under the mfluence of a visual tend- 
ency for the sidewall to determine the rider’s horizontal In other words 
we are accustomed to ride in a visually upright position on a horizontal 
surface, and withm limits this visual factor exerts its own influence A new 
perceptual integration is achieved, in which gravitational factors are the 
primary determinants, but which is also influenced to some degree by visual 
cues (pp 316-318) 

The observations just cited raise some interesting questions, onlv^ 
a few of which we can consider here First let us ask How can we 
account, in terms of learning theory, for the dominance of gravita- 
tional cues over visual cues^ It would appear that when the two are 
first dissociated, there is a period of profound conflict, but then, re- 
markably quickly, the subject “learns” to orient on the basis of 
gravity rather than vision Why so^^ Because, presumably, the conse- 
quences of giving gravity priority are more rew^arding, less pumshmg 
than are the consequences of giving vision priority and disregarding 
gravity In other words, it is more important, in the total economy of 
an organism, to “obey” gravitational cues than it is to obey certain 
visual ones, and one can reasonably infer that the issue is decided 
(quite quickly) upon the basis of simple rew^ards and punishments 

But then one wonders if the observations just cited have any unique 
or differential bearing upon the assumptions underlying revised two- 
factor theory Perhaps not, in any way that is immediately apparent 
But further attention to the problem may suggest some researchable 
inferences 

IX Response initiation and Related Problems 

Although the preceding sections of this chapter may convey the 
impression that we are at last “closing in” on some of the most recal- 
citrant of psychological problems, there is no denying that sizable 

^ It must be kept in mmd that the intensity of the total mass acceleration acting 
upon the body in a motordrome is se\eral ames greater than normal gravity Be- 
cause of this augmentation of intensity, it is possible that spatial perception is here 
influenced somewhat more by what we have called gravitational factors than 
would be the case if the direction of gravity could be changed without its magni- 
tude also being altered (cf the “haunted-swing” illusion) 
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mysteries are still at large One of these is the mysteiy of response 
imtiation This problem does not, of course, aiise in a strict S— R 
psychology a stimulus impinges upon the organism and, because of a 
direct (innate or learned) neural connection therewith, a particular 
response ensues But as soon as this hypothetical connection is broken — 
as it obviously must be— by the introduction of central (intervening) 
processes, the whole question of response selection and control re- 
emerges in acute form The assertion that the person, self, or ego 
chooses, decides, \vills what to do, while corresponding to common 
perception, does not provide a scientific solution to the problem Does 
cybernetics substantially advance our understanding here^ 

Slack (1955), to cite only one of many contemporary theorists who 
have been much influenced by cybernetic thought, has taken the 
position “that w^e do not know what the stimulus is unless we know 
what the response is and we do not know what the response is unless 
we know w^hat the stimulus is” (p 267) This view, of course, is 
predicated on the assumption that we are here dealing, not with open- 
circuit reflexes, but with closed-circuit, voluntary, self-regulated re- 
sponses of the sort we have identified as “habitual ” Without benefit 
of constant sensory feedback fro 7 n the response, as it is occurring, the 
response is assumed to be impossible 

After half a century of radical behaviorism (S — psychology), this 
all sounds quite daring and new But it is not We have already seen 
(m Chapter 5) that in 1896 Dewey clearly perceived the difference 
between a reflex a? c and the total neural circle involved in actual be- 
havior And in his Principles of Psychology, published in 1890, in the 
chapter on “Will” (in Vol II), Wilham James even more explicitly 
anncipated piesent-day developments For full realization of how truly 
remarkable this chapter is, in light of contemporary thinking, it must 
be read m its entirety, but perhaps its most remarkable feature is the 
extent to which the author makes sensory feedback from action es- 
sential to the continuation, and even initiation, thereof James cites 
climcal reports on a number of individuals in whom kinesthetic impulses 
were lacking or seriously impaired, and shows that here voluntary 
movement was possible only with visual guidance For example, he 
quotes the following passage from a report by Strumpell concermng 
“his w^onderful anaesthetic boy, whose only source of feeling were the 
right eye and the left ear” (p 489) 

“One could observe how his eye was directed first to the object held 
before him, then to his own arm, and how it never ceased to follow the 
latter during its entire movement All his voluntary movements took place 
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under the unremitting lead of the eye, which as an indispensable guide, 
was never untrue to its functions” (pp 491-492) 

And when, in such a case, vision is ehminated, it is often impossible 
for the individual even to start a particular movement 

Thus Dr Strumpell relates how turning over the boy’s hand made him 
bend the little finger instead of the forefinger [as directed], when his eye 
was closed “Ordered to point, e g , toward the left with his left arm, the arm 
was* usually raised straight forward, and then wandered about m groping un- 
certamty, sometimes getting the right position and then leaving it again 
Similarly with the lower limbs The turmng of the head, too, from 
right to left, towards certam objects known to the patient, only ensued 
correctly when the patient, immediately before his eye was bandaged, 
specially refreshed his perception as to what the required movement was 
to be” (p 491) 

“This,” says James after reviewing much similar evidence, “is perhaps 
all that need be said about the existence of passive sensations of move- 
ment and their indispensableness for our voluntary activity” (p 492) 
He was clearly convinced that response without concomitant stimula- 
tion was highly inefficient, if not altogether impossible, and he quite 
energetically opposed the notion, then current, of a ^^jeeling of innerva- 
tion ” The only feeling of movement or action, James argued, comes 
from the kinesthetic and other sensations which the movement itself 
produces (see also Mead, 1934, pp 70-71) 

Moreover, James anticipated present-day developments in positing 
a notion very similar to that implied by Powers, McFarland, and Clark 
in the use of their term “Reference Signals ” He said 

One has only to play tenpins or billiards, or throw a ball, to catch his 
will m the act, as it were, of balancing tentatively its possible effects, and 
ideally rehearsmg various muscular contractions nearly correct, until it 
gets just the right one before it, when it says “Now go’” This premonitory 
weighmg feels so much like a succession of tentative sailmgs forth to 
power mto the outer world, followed by correction just in time to avoid 
the irrevocable deed, that the notion that outgoing nerve-currents rather 
than mere vestiges of former passive sensibility accompany it, is a most 
natural [but erroneous] one to entertain (p 493) 

We may consequently set it down as certam that, whether or not there 
be anything else in the mind at the moment when we consciously will a 
certain act^ a mental conception made up of memory-images of these sensa- 
tions, defining which special act it is, must be there (p 492, italics added) 

The implications of this way of thinking for skill learning did not 
escape James, and we find him saying 

So m acquirmg any art or voluntary function, the marksman ends by 
thinking only of the exact position of the goal, the singer only of the perfect 
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sound, the balancer only of the point of the pole whose oscillations he must 
counteract The associated mechanism has become so perfect m all these 
persons that each \ariation m the thought of the end is functionally cor- 
related with the one movement fitted to bring the latter about (p 497 ) 

But despite the shrewdness of these observations (and of similar ones 
by Dewey), they fell among stones and were not to get a congemal 
hearing for more than half a century Why, one must ask, was this 
the case^ The answer undoubtedly is complex, but we may conjecture 
that one important element in the situation was the lack, in James’ 
account, of a proper emphasis upon motivation or dynamics If our 
analysis is sound, a particular course of behavior is selected, or ‘‘willed,” 
because its image, or anticipated occurrence, arouses hope, whereas its 
nonoccurrence or incorrect occurrence arouses no hope, or even fear 
There is presumably, as James implies, a kind of scanning of various 
possibihties which occurs in connection with response selection (cf 
Jeffress, 1951, Adrain et al , 1954), and here symbolic behavior seems 
to play a crucial role But this way of thinking about the problem 
only raises the anterior question How is the appropriate scanmng or 
symbolic behavior itself selected^^ Why, for example, does a rat at a 
choice point move its head (in VTE) laterally, rather than vertically — 
or why does it move its head at alP Or, in the case of a human being 
confronted by a particular problem, why do relevant, rather than 
purely random, symbols “occur” to him^ Admission of connectiomsm, 
at this level, might solve the problem, but, having rejected it at the 
level of gross, overt behavior, one is loath to admit it at the symbolic 
level Perhaps this is a mistake, perhaps connectiomsm holds for sym- 
bolic behavior There must, after all, be a limit to this positing of 
higher and higher mechanisms of control (cf Powers, McFarland, and 
Clark) and to the introduction of more and more intervemng (“cen- 
tral”) factors Otherwise one explains nothing and ends in an infimte 
regress 

“ Or the solution might go as follows A hungry boy who has never before 
eaten an apple sees one and samples it It is pleasant tasting and satisfies his hunger 
Conceivably the sight, smell, and taste of the apple and the other sensations (pro- 
priocepme and the like) associated with the act of eatmg become conditioned 
to the hunger drive, so that when the hunger subsequently recurs, the boy will 
“think of” apple eatmg, le, he will have images derived from the earlier expe- 
rience The hope (secondary reinforcement) which was conditioned to the sen- 
sauons will now generahze to the images, and, lacking confiictmg impulses, the 
boy will start trying to find another apple Here we are makmg a number of as- 
sumptions which are highly unorthodox as far as conventional learmng theory 
is concerned, but they may nonetheless be vahd Thorndike by-passed any such 
thmking on the premise that, m the situation described, a bond is forged directly 
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Or perhaps the solution lies in the notion of an even more elaborate 
and comprehensive type of scanning Many electronic devices (eg, 
television and radar) employ extensive “sweep circuits”, and it is 
conceivable that similar activities go on constantly in the brain, during 
consciousness (cf Pitts Sc McCulloch, 1947, Walter, 1954, Ellmgson, 
1956) and that our images and other symbolic reactions are selected by 
a process whereby the needs of the moment either concentrate the 
scanmng process in certain “areas” or produce a differential sensitivity 
of some sort Here we are obviously still in a no-man’s-land, but the 

between hunger and apple-seeking and apple-eating beha\ior The difficulties in- 
herent in this view are well known In Pa\lo\ian parlance, one might speak of 
some reaction elicited by the apple (eg, sain ation) getting conditioned to some 
stimulus experienced just before (or as) the apple was eaten (eg, the sight or 
smell of the apple), but one would not be inclined to think of the hufiger dme 
becoming a conditioned stimulus This is precisely what the foregoing analjrsis 
presupposes, that the hunger becomes the conditioned stimulus for arousing an 
image of apple and apple eating, to which has also been conditioned the emotion 
of hope which, for reasons previously considered in this book, would put the 
individual into more or less appropriate action In Section VII of this chapter some 
importance has already been attached to the concept of “reference le\el,” image, 
or standard toward which an error-actuated servo-system always moves Perhaps if 
images (of objects and of actions) get condmoned to drives, the program of 
“scansion” and “search” is solved Moreover, there is already a considerable litera- 
ture suggesting a relationship between drive, or need, and imagery In a recent 
review of that literature, Noel Jenkins (1957) refers to the “relationship between 
need-state and such processes as imagery, association, and problem solving” (p 
107) and goes on to summarize the views of McClelland (1951) thus “Motivation 
IS presumed to have different effects at different intensity levels When it is weak, 
in the ‘wish fulfillment’ stage, goal images occur As it increases, a ‘push toward 
reality’ is experienced, in which deprivation imagery tends to replace goal 
imagery” (p 108) In some ways the hypothesis under examination here is 
reminiscent of the older notion of the “association of ideas,” but the defect there 
was lack of the concept of reinforcement, and much the same comment can be 
made with respect to so-called S — S contiguity theory (Tolman, 1932, Birch L 
Bitterman, 1951) This note is written just as this book goes to press, otherwise 
an effort would be made to integrate the above analysis into the text and to 
explore further its systematic implications But from this preliminary examination. 
It seems to have considerable promise as a means of extricating ourselves from 
the dilemma into which our analysis up to this point has led us (For a some- 
what similar attack upon this problem, see Miller, 1958, also Dollard & Miller, 
1952, cf footnote 4, Chapter 5 of this volume, Fairbanks, 1954, Mowrer, i960, 
Chapter 8, Section VII ) 

“How, one wonders, has this problem been solved in the great self -regulatory 
machines^ Or has it been solved^ An operator still has to “wire m” the instruc- 
tions, 1 e , make certain connections before the machine can operate In living 
orgamsms there is likewise a certain mimmum of fixed connections, but there 
is also an apparent indetermmancy which does not exist in the machine 



288 LEARNING THEORY AND THE SYMBOLIC PROCESSES 

clinical phenomenon of aphasia offers some umque opportumties for 
trenchant inquiry The authoi is indebted to Piofessor M D Steer, 
of Purdue University, for this observation by N C Kephart “The 
trouble with the mentally retarded child is that he has his marbles but 
doesn’t have enough of them, whereas the brain-mjured [aphasic] 
child has all his marbles but can’t find them ” Once the aphasic in- 
dividual is reminded of the name of the object in question, he can 
utter the word quite readily, the trouble, truly, is one of locating, find- 
ing it Osgood, sensing the special theoretical importances of aphasia, 
has recently instituted an intensive piogram of investigation, but, in 
a less dramatic way, everyone is familiar with the problem in terms of 
momentary inability to “get” just the right word, to recall a name, and 
like experiences Whether these functional failures are dynamically 
determined (blocked), as Freud (1920) has maintained, or have some 
other explanation is not immediately important, but they function, in 
any case, quite admirably to remind us that selection occurs in thought 
as well as in deed and that both success and failure in respect to these 
functions pose problems for future inquiry (see Schuell & Jenkins, 

1959) 

X Learning and the Unconscious 

The only other problem to which we shall address ourselves in this 
chapter has to do with the role of ^conscious activities in mental life, 
and more particularly the question of their relationship to learning As 
we have repeatedly seen, both living orgamsms and machines can “be- 
have” in highly complex and “intelligent” ways without necessarily 
exhibiting the phenomenon of learning And learmng may be found in 
relatively simple organisms, and at least its analogue can be exhibited 
by even simple machines (Sluckin, 1954) Therefore, psychologists have 
been moved to ask Is consciousness necessary for learning^ Under the 
heading of “incidental learning,” “learmng without awareness,” and 
the like, various writers (McGeoch & Irion, 1952, Postman & Jarrett, 
1952, Scheerer, 1953, Eriksen, 1958, McConnell, Cutler, & McNeil, 
1958, and others) have dealt with this issue in interesting and ingenious 
ways, but, from one point of view, the question is already answered, 
and categoncally so All learmng, it seems, is “unconscious ” As noted 
elsewhere (Mowrer, i960, Chapter i), there is never any sensation or 
awareness of learning as such We see the results, in our own behavior 
and that of others, of learmng, and we can deliberately put ourselves 
into a position or situation to learn But this, presumably, is not quite 
the point in the studies cited 
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Perhaps the problem will take on greater tangibility if \\ e get down 
to cases Suppose a human being is used as a subject in an expeiiment 
on the conditioning of fear, as measured by the psychogalvamc response 
(PGR), and that a tone and an electric shock are the CS and UnCS, 
respectively After a few paired presentations of these two events, the 
subject will report “The tone is followed by the shock and so makes 
me afraid ” But how does he know this^ If the learning involved only 
the conditiomng of fear, then the tone might well evoke this response, 
but the subject would not know what he was afraid of Normally, along 
with the fear conditioning, there will be a cognitive, or imaginal, con- 
ditiomng the tone will call up, not only the emotion of fear, but also 
an image of the shock, thus enabling the individual to “know” why 
he IS afraid — he is afraid of the shock (see Chapter 5) 

It IS not uncommon, however, for human beings (and quite possibly 
other organisms) to experience emotions and 7 iot know why Here, 
apparently, the emotional condmomng “comes through” but the 
imagmal conditioning (memory) does not Consider this instance A 
friend of the writer’s normally eats and sleeps well, but for a few days 
he noted slight disturbances with respect to both these functions and 
a vague feeling of uneasiness And before going to bed on the mght m 
question, he sat quietly for half an hour or so trying very hard to 
discover the source of his “anxiety ” Finally, without success, he went 
to bed and shortly to sleep, but later in the night he woke in a “cold 
sweat” and upon getting up to dry himself off had a clear perception 
of the cause of his difficulties Two days hence he was to read a paper 
at a scientific meeting The paper was already written, and he had 
lather looked forward to presenting it So, superficially at least, there 
was “nothing to worry about ” But, as the time approached for the 
actual presentation, his “unconscious” had become apprehensive about 
the presentation, considerably in advance of his knowing consciously 
why he was emotionally aroused Perhaps it is observations of this kind 
that have prompted Lacey (1956) to refer to the emotions as “the 
voice of the unconscious” (see also Section I) When we have the 
affects without the appropriate imagery, we are likely to say that our 
unconscious is “bothering” us, whereas, if the appropriate imagery is 
present, the same emotional disturbance will be referred to in quite 
different terms 

^*The writer is indebted to Dr Herbert Lansdell (1958) for first calling his 
attention to the possibility that emotional responses can be conditioned (through 
thalamic centers of the brain) without concomitant cognitn e learning (presumably 
in the cortex) and thus suggesting a neuroanatomical locus for “the unconscious ” 
In support of the notion that “learning without fine discrimination” occurs in the 



290 LEARNING THEORY AND THE SYMBOLIC PROCESSES 

Usually the assumption, in cases such as the one cited, is that the 
“ideational content” that ought to accompany the emotion has been 
“repressed” or otherwise dynamically obstructed And in Chapter lo 
we shall revert to this line of thought But here we are more particularly 
concerned with those efforts that have been made to study this sort 
of phenomenon experimentally In a well-known experiment reported 
by Divin in 1937, w^ords were passed in review on a memory drum 
before human subjects, and on each occurrence of the word “barn,” 
the subjects received an electric shock Later it was found that the 
words such as “cow” and “chickens” also produced emotional leactions, 
as objectively measured by the PGR, without the subjects’ awareness 
Here, obviously, was a form of “unconscious generalization,” which 
was being mediated by a concept which the subjects had not made 
explicit to themselves 

In the controversial Greenspoon experiment (already cited in Chap- 
ter 3), human subjects, under appropriate conditions of social rein- 
forcement (minimal “grunts” of approval), show an increased tendency 
to produce, for example, plural nouns without being “aware” that the 
experimenter has been differentially reinforcing this category of re- 
sponses (cf Mandler 8 c Kaplan, 1956) It would seem that, not fear, but 
hope (and resulting habit strength) has been conditioned to a certain 
class of verbal responses without the subject having a clear image of 
that class, category, or concept Here it can hardly be a question of 
repression, since there is nothing unpleasant or embarrassing about the 
situation Perhaps, since the “unconditioned stimulus” is a complex 
one, 1 e , a concept rather than just a specific word, the difHculty is 
rather one of forming a clear image of it The lather astonishing thing 
IS that such categories can be identified emotionally^ before they are 
intellectually^ Can this be the primitive basis for imputation of “crea- 
tiveness” to the unconscious (cf Sachs, 1942, Jung, 1958)^ 

reticular formation, Lansdell cites MacLean (1955), Sharpless & Jasper (1956), 
Jasper (1956), Himwich (1958), and somewhat earher sources (eg, Morgan & 
Stellar, 1950, pp 271 and 447) For exploration along similar lines, see Bunch 
(1958), see also the discussion in Section I of this chapter of the distinction be- 
tween wakefulness (“arousal’) and consciousness (“cognition”) 

“Had It been available earlier, a new paper by Dulany (i960) could have 
altered and, quite possibly, simphfied some of the foregoing discussion (see also 
Chapter 2, especially footnote 4) The Greenspoon type of experiment is so 
interesting and, for revised two-factor learning theory, embarrassing because it 
purports to show learning of a word class without conscious occurrence or use 
of any word or phrase on the part of the subject for this class Said otherwise, 
the dilemma is this How is it possible for a human being to develop an in- 
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Guthrie has criticized Tolman’s version of learning as cognition 
without motivation Normally, if our vie\\s are \alid, learning in\olves 
both a cognitive (imagmal) and a motuation (emotional) aspect Al- 
though both occur, it seems, by means of conditioning, they are ap- 
parently mediated by two rather different mechamsms Certainly there 
IS no a prion reason why these two forms of learmng should always 
function in a strictly coordinated manner, and if the emotional reaction, 
so to say, gets ahead of the ideational reaction (or if the latter is dynami- 
cally inhibited), then we would have the condition typically described 
as “unconscious motivation,” i e , feelings of depression, elation, or 
apprehension which are not, so far as the subject can see, realistically 
justified Perhaps the “justification” is there but is simply not perceived 
The discovery or recovery of such ideation often constitutes the ex- 
perience commonly termed “insight ” 

creased tendency to utter, for example, plural nouns without the use of any y ord 
or phrase or concept to mediate the transfer of reinforcement from uttered words 
to unuttered words of this class^ A rat learns to press a bar because there is a 
sameness about the patterns of sensory feedback which are followed by reward, 
and which therefore take on the capacity to arouse (or “mediate”) secondary rein- 
forcement In other words, the habit of pressing the bar for food de\elops be- 
cause there is so much in common between all bar-pressing responses But men 
IS not at all “the same” as turnips or boxes, and it is not immediately apparent how 
rewarding the subject for saymg “men” will increase his tendency to say “turnips” 
or “boxes” or other plural nouns, unless the class of words which brings rew^ard 
is discovered, verbalized, and used as a guide to the selection of such words The 
Greenspoon type of experiment seems to show that such learning is nevertheless 
possible — and has been especially congemal to those investigators who, following 
B F Skinner’s lead, have largely rejected the concept of mediation (i e , mediated 
generalization) The Dulany paper is highly pertinent at this juncture, for it 
provides an alternative way of mterpretmg the Greenspoon effect along quite 
different lines, which are compatible with reinforcement principles Because 
Dulany’s analysis is slightly involved, we shall not attempt to reproduce it in 
detail But two or three sentences will catch the general tenor “If we can even 
speak of learning here, Ss learned or msightfully grasped an often confirmed 
hypothesis, an hypothesis that ‘Umhmm’ followed upon associating in a series 
They did not learn to respond with plural nouns, the increase in plural nouns 
IS better credited directly to the transfer of a complex verbal habit” (p 7) “If 
associating after plural nouns brings more plural nouns with a set to continue 
a series than with a set to find a new category, the present verbal reinforcement 
effect could be ascribed to the mediation hypothesis that cue prior verbal habits” 
(p 8) It seems that Dulany is well on the way to dissolving a very troublesome 
paradox and to opening the way to the further development and consolidation 
of systematic learning principles (cf Staats, 1959b, Maltzman, Brook, Bogartz, 
Summers, 1958, and Dulany and Eriksen, 1959) 

^®For a collection of interesting papers on “unconscious motnation,” see Stacey 
& DeMartmo (1958), also J G Miller (1942) 
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The foregoing discussion is admittedly fragmentary and far from 
logically ngorous, but the question of conscious and unconscious 
factors in learning and behavior control is so important that it cannot 
be Ignored merely because it is still perplexing This mormng the 
author had the experience, as not infrequently happens, of waking up 
precisely at his usual nsing time, slightly in advance of the ringing of 
the family alarm clock He was dreaming about some difficulties con- 
nected with the completion of this chapter, and they were sufficiently 
disturbing to disrupt sleep How, witfun the framework of learning 
theory, as presently conceived, can we account for this type of phe- 
nomenon^ 

Or, take the remarkable effects that can be produced by means of 
hypnosis — or that occur spontaneously in various pathological states 
of dissociation fuges, multiple personality, and the like These phe- 
nomena are so tangible and yet so baffling that at least one erstwhile 
student of learning (Hilgard, 1958) has decided that in the whole area 
of psychology, they offer the most important and crucial research possi- 
bilities and challenges In a volume such as the present one, it is not 
possible or, at this stage of knowledge, appropriate to give much at- 
tention to this sort of thing, but in Chapter 10 we shall briefly return to 
It, from a somewhat different vantage point In the meantime, we shall 
explore another of the many directions in which modern learning 
theory ramifies 

The writer has just had occasion to review a remarkable book-length manu- 
script entitled The Mind of Robots, by J T Culbertson (i960) In it the author 
argues that it is now possible, at least theoretically, to produce the phenomenon of 
consciousness synthetically Other students of automation have, of course, often 
commented upon the parallels between the accomplishments of computers and of 
minds, but only by a far stretch of the imagmation can the former be said to 
be “conscious ” Now, by a new set of assumpuons and principles (including those 
of “nerve nets”). Dr Culbertson believes that bona fide consciousness can be cre- 
ated artificially This is a bold proposal and, if substantiated, will constitute another 
major breakthrough in man’s attempt to understand his Universe (Had it been 
possible, this footnote would have appeared, as mdicated, on p 253) 




Learning, Causality, 
Probability, and Statistics 


This chapter and the next one stem from the following, somewhat 
anomalous circumstances If one reads the writings of mathematicians 
on the subject of statistics and probabihty, one finds frequent allusion 
to certain ‘‘psychological problems” which are at least tacitly dis- 
avowed And if one follows the work of psychologists, one discovers 
that for certain purposes they resort, quite freely, to mathematical 
procedures, with the intimation that the problems involved are non- 
psychological or at least metapsychological 
If one could be sure that this interaction represented a genuine division 
of labor and competence, all would be well But there are indications 
that some of the problems which the mathematicians say are psycho- 
logical are the same as, or at least not very different from, the problems 
which psychologists take to be mathematical, with the result that these 
problems are tossed back and forth, in the manner of the proverbial 
“hot potato,” and thus remain very much “up in the air ” Here our 
attempt will be to try to get a firmer grasp on some of these issues and 
to try to think them through psychologically rather than wish them 
off on the mathematicians After all, ultimate reality is presumably 
umtary — and the distinction between mathematics and psychology 
arbitrary 

1. The Problem Stated and Exemplified 

This chapter has been written, discarded and rewritten three times, 
and were it not that the rest of this book has already gone to press, 
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xt IS entirely possible that, after due criticism and reconsideration, the 
present version would suffer a similar fate ^ Therefore, what is to 
follow IS offered with no gieat confidence, and certainly with no 
intimation of finality But something has surely been gained from 
earlier explorations and the ovei-all nature of the underlying problem 
or problems more precisely identified Moi cover, developments in the 
psychology of learning which have been leviewed in Learning Theory 
and Behavior and in antecedent chapters of the present volume suggest 
a much more natural linkage with probability theory than did earlier 
behavioristic and reflexological approaches, and if we do not here 
fully succeed in our attempt to explicate this relationship, others, 
profiting from our mistakes, eventually will 

Gradually, from the earlier efforts to write this chapter, one gen- 
erality has emerged which can be set forth with something like assur- 
ance, namely, that all scientific endeavor is, in the final analysis, con- 
cerned with the ascertainment of causal connections Of late it has been 
fashionable in some quarters to deny the validity of the whole notion 
of causation, but here we shall continue to accept both the validity 
and the necessity of this concept and will assume, further, that it is the 
sine qua non for all practical prediction and control (cf Bolles & 
Messick, 1958, Boole, 1854, Fisher, 1956, Mandler, 1959, Peirce, 1878b, 
and von Mises, 1957, also Sections II and VII) 

In the history of the race and in the development of each individual, 
many cause-effect relationships are so obvious, and so quickly “learned” 
(see also Chapter 9), that no refined form of inquiry or “proof’ is 
needed For example, it is so readily and so umversally discoverable 
that a sharp object pressed into the skin will (normally) cause pain 
that there is not the least doubt about it and no one needs to set about 
elaborately investigating and establishing this “effect” And so far 
as is known, there has kkewise never been much doubt or controversy 
about the superiority of round wheels over square ones ^ But there 

^For illuminating comments on an earlier draft of this chapter, the writer is 
much indebted to his colleagues, Dr Lee J Cronbach, Dr William E Kappauf, 
and Dr Lloyd G Humphreys, and to Dr Leonard J Savage of the Department 
of Mathematics at the University of Chicago While these gentlemen cannot be 
held accountable for what is said in the present version of this chapter, they at 
least deserve credit for protectmg the reader from earher, more primitive false 
starts and errors 

^Bilodeau (1952) makes the point well when he says “Of the countless hy- 
potheses which are set up every day by scientist and layman alike, most do not 
undergo the rigors of a statisucai test Regardless of the nature and quantity of 
data available, most of our decisions are made — hypotheses are retained or rejected 
-—without recourse to mathematical formulation or development” (p 271) 
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are many other situations where causalitv is much less clear and good 
practice conespondmgly less certain, and here we ha\e resorted and 
are still resorting to those specialized techniques which, hopefully, 
help make the ‘‘evidence” less equivocal and are conduci\e to general 
agreement 

One of the most rudimentary and important of scientific devices is, 
of course, that of “controls” or “checks ” If, for example, on the basis 
of casual observation, someone develops the hypothesis that fish will 
helpfully fertilize growing corn, and if one then applies fish to all 
the corn planted in a given year and if the corn does indeed grow 
unusually well that year, there is a presumption that the hypothesis 
IS valid But a skeptic might cogently argue that the good yield was 
due to “something else” — perhaps some concomitant variation in 
cultivation, unusually abundant or propitious rainfall, or some other 
“confounded” (coincidental) variable So the sensible thing to do 
IS to apply the special treatment to certain hills of corn and not to 
others If, now, it is found that the treated hills produce a perceptibly 
larger yield than do the untreated ones, one cannot attribute the effect 
to some general (confounded) condition, such as cultivation or rain- 
fall, and has to admit that the effect is probably due to the special 
treatment ^ 

But why IS one here disposed to say “probably” rather than “cer- 
tainly”^ Systematic error (confounding) has been eliminated, so why 
IS not the causal relationship unambiguous and sure^ In some ways 
this question is pedantic, for without having a precise answer to it, 
primitive “scientists” and men of affairs made innumerable important 
discoveries and demonstrated them to others with sufficient cogency 
to effect many new and improved ways of doing things ^ Nevertheless, 
the question is interesting, and as late as 1876 we find Charles Darwin 

®For discussion of modern refinements m the use of experimental controls, espe- 
cially in agriculture, see Fisher (1937) 

^Writing in 1956, Newman remarked that “It is three hundred years exacdy 
since Pascal and Fermat conducted their famous exchange of letters dealmg with 
a question proposed by the gambler Chevaher de Mere The question concerned 
the division of stakes at games of dice, and the answer to it, contained in the 
correspondence of the two great French mathematicians, is generally regarded 
as the foundation of the theory of probabihty ” But in a footnote Newman shows 
that “the Italian mathematician Jerome Cardan (Gerolamo Cardano), of Milan 
(1501-1576), was the real pioneer in this field” (p 1319) In any case, it is clear 
that science did not have to wait upon the emergence of probability theory and 
statistics but IS a much older enterprise In fact, some sciences (viz physics and 
astronomy) long spurned statistics and even now sometimes look askance at this 
disciphne 
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(see Fisher, 1937) posing it to his cousin, Sir Francis Galton, m the 
following context Having, with others, casually noted the superior 
vigor of cross-fertilized plants, Darwin set out to establish or “prove” 
the relationship scientifically Thus he sprouted and grew several cross- 
fertilized seeds of certain plants along side of self-fertilized seeds of 
the same species, under as nearly identical conditions as he could 
achieve The results obtained for a variety of wheat, Zea mays, are 
shown in Table 8~i (adapted from Fisher, 1937) 

TABLE 8-1 

Heights (in inches) of Crossed and Self-fertilized Wheat Plants as 
Transmitted by Mr Darwin to Mr Galton 


Pot 

Crossed 

Self-fert 

I 

^ 3 % 

17% 


12 

20% 


21 

20 

II 

22 

20 


19^/4 

18% 



18% 

III 


18% 


^ 0 % 

15-x 



1654 



18 


23% 


IV 

21 

18 





^3 



12 

18 


From merely inspecting these two arrays of numbers, one quickly 
gets the impession that the cross-fertilized plants were, in general, 
taller than the self-fertilized ones, and the simple mathematical proce- 
dure of obtaining the mean height of the plants in the two arrays 
(20 I inches vs 17 5 inches) amply confirms this impression, but, m 
light of the marked vanability in the heights of both the crossed and 
the self-fertilized plants, it is not hard to imagine that the difference 
in the two means could be due to “chance” and therefore not reflect 
the influence of cross-fertilization at all In other words, with the 
amount of “spontaneous” variability which occurs in both sets of 
plants, It is clear that the means for various other sets of 15 plants, 
drawn at random from either of the two “parent populations” (all 
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crossed and all self-fertilized Zea mays imaginable), would themsehcs 
show considerable variability Therefore, one is left with the disturbing 
possibility that the difference between the t\\ o means actually obtained 
m Mr Darwin’s experiment was not due to cross-fertilization but to 
an “error” or “accident” of samphng And w^hat Darwin washed 
to know was how to interpret and evaluate this possibility, precisely 
That Mr Galton did not know any very satisfactory solution to 
the problem thus posed is indicated by the fact that his principal 
analytic device was to arrange the plants in two arrays in the order of 
tallest to shortest, as shown in Table 8-2, and note the difference (in 
the third column) between each corresponding pair 

TABLE 8-2 

Heights of Mr Darwin's Wheat Plants (see Table 8-1) Rearranged m 
Descending Order of Magnitude, with Differences Shown 


Crossed 

Self-fert 

Difference 


20% 

-sVs 

23% 

20 

-3% 

23 

20 

-3 

22% 

18% 

-3% 

221/8 

18% 

-3% 

22 

18% 

-3% 

21% 

18 

-3% 

21% 

18 

-3% 

21 

18 

-3 

21 

17% 

-3% 

20% 

1^8 

-3% 

19% 

16% 

-2% 

18% 

15% 

-2% 

12 

15% 

+3% 

12 

12% 

+0% 


It IS apparent, when the data are thus re-arranged, that the self- 
fertilized plants exceed the crossed plants in only two of the 15 
cases or comparisons, and from a common-sense point of view, such 
evidence certainly seems favorable to the hypothesis under examina- 
tion, that cross-pollinated plants are more vigorous than self-pollinated 
ones But Mr Galton had no way of precisely stating or estimating 
the degree of relationship thus prevailing, as is indicated by the fact 
that the best he could do, in returmng the data to Darwin, was to 
append the words, “very good ” Almost anyone, after examining Dar- 
win’s data would share the impression that these findings do indeed 
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favor the hypothesis in question, but what is manifestly lacking is a 
method of stating the degree or amount of the association or relation- 
ship between mode of pollination and plant vigor, or even the assur- 
ance or confidence that there ts such an association, with greater ac- 
curacy than IS implied by such expressions as “favorable” or “very 
good ” 

In other words, causal relationships are often suspected (as in the 
example cited) but are not clear-cut, and the whole thrust of modern 
“statistics,” It will here be argued, has been to try to find a method 
or model of some sort for designating the phenomenon of association, 
correlation, or causation in definite, quantifiable units of measurement 

li Causality and the Concept of Chance 

In a situation such as the one last described in the preceding section, 
there is a temptation to speak of the causal relationship prevailing be- 
tween cross-fertihzation (the so-called independent variable) and plant 
size (the dependent variable or effect) and to differentiate this rela- 
tionship, categorically, from the operation of so-called chance factors 
in the situation In one respect such a distinction is important, for 
what we want to know, in practice, is whether the obtained results, 
in any given instance, could be due to “chance factors” or are properly 
attributable to some systematic influence such as that hypothesized by 
Mr Darwin But before we can profitably pursue this problem, it is 
essential that we carefully scrutinize the assumptions underlying the 
phenomena which we commonly denote by the word “chance ” 

In both the crossed and the self-fertilized wheat plants which were 
grown by Mr Darwin, there was considerable intragroup variabihty 
Let us begin our analysis by supposing that there had been no such 
variabihty and that all the plants in each of the two groups had been, 
in respect to height, absolutely identical In other words, let us sup- 
pose not only that the mean of the self-fertihzed plants was 17 5 inches 
but that all the individual plants constituting this group were also of 
precisely this height And let us similarly suppose not only that the 
mean height of the crossed plants was 20 i inches but that all of the 
individual plants comprising the group were exactly this same height 
In such a situation no “statistical” problem would exist If, in other 
words, each cross-pollinated plant invariably grew to be 2 i inches 
taller (at a ceitain age) than each self-pollinated plant, there would 
be no question whatever concerning the “relationship” between the 
pollination process and plant vigor 
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When working with biological materials, such an outcome is of 
course, most unusual, but the suppositious illustration is by no means 
absurd, for in many mechamcal systems such relationships regulailv 
exist and occasion no surprise For example, one can easily construct 
a machine such that if a given quantity of lead for any other homo- 
geneous substance) is placed at one point on the machine it will in- 
variably cause a pointer to move a certain distance on a calibrated 
scale Here the relationship between “cause” and “effect” is so clear 
and uncomplicated that no one bothers to ask if the movement of the 
pointer could be “due to chance ” Here our direct perceptions are 
deemed to be completely unambiguous and trustw orthy But if the 
pointer “spontaneously” moved around a good deal regardless of 
whether the piece of lead was present (“experimental” condition) or 
absent (“control” condition), we would then obviously have a prob- 
lem and would be hard-put to ascertain or “weigh” the effect of the 
piece of lead If we applied the lead and the pointei moved, we could 
not be sure but that it would have “moved anyway”, or if we ap- 
plied the lead and the pointer did not move, there would always be 
the possibility that the effect had been counteracted by the random, 
uncontrolled forces operating on the machine 

So we now have an analogue of the circumstances under which the 
practical need for “statistics” arises namely, circumstances w^herein 
the dependent variable -fiiictuates markedly, regardless of whether we 
apply the particular independent variable, or cause, in w^hich we are 
interested If all of Darwin’s self-fertilized plants had grown to pre- 
cisely one height and all the cross-fertilized plants to a precisely dif- 
ferent height, he would not have needed to consult Mr Galton, the 
statistician the “effect” would have been perfectly clear and un- 
ambiguous to direct inspection But when, as we say, chance factors 
are also operating (as concomitant, uncontrolled causes), the evalua- 
tion of a specific “effect” becomes very difficult, ® and in some quarters 

® There may, to be sure, be some slight variabihty in the place at which the 
pointer comes to rest when the piece of lead is placed on the machine (“scales”) 
on successive “trials,” and we may, therefore, wish to use as our estimate of the 
true “weight,” impact, or effect of the lead the average for se\eral such readings 
But this IS not to say that we have the shghtest doubt as to what made the pointer 
move in the first place In other words, the mam cause-effect relauonship is per- 
fectly unambiguous, and we ascribe the variations noted to “lost motion” or other 
imperfections in the machine 

®The effect produced by the independent variable may be precisely the same 
in both cases, but where there is so-called spontaneous variation in the dependent 
variable, the specific effect is so “blurred” that confidence is much reduced “Sta- 
tisucs” is an attempt to restore this confidence 
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the notion has arisen that cause and eifect and ‘‘chance” are radically 
different orders of events and must be treated accordingly But our 
example suggests (and validly so) that “chance factors” are just 
those “causes” which we cannot accurately identify and precisely con- 
trol 

Let us revert, once again, to Mr Darwin’s wheat plants It is obvious 
that the spontaneous variation in plant height was relatively great in 
both the crossed and the self-fertilized specimens 23% inches to 12 
inches in the former, 20% inches to 12% inches in the latter We must, 
of course, ask Now what caused ths^ And we are inclined to answer, 
“Well, nothing in particular — ^this variability was just due to chance ” 
This IS misleading A more exact answer would go something like 
this “There were undoubtedly many pertinent factors operating m 
the situation over which Mr Darwin had no control e g , germination 
vigor of individual seeds, amount and quality of nutrient stored therein, 
adventitious differences in moisture and nutrient m the surrounding 
soil, minor inequalities in available light, and so on ” In other words, 
the so-called spontaneous vanations in the height of the plants were 
presumably just as defimtely “caused” as was the systematic difference 
which was attributable to cross-fertilization, but since the sources 
of the so-called spontaneous variability were not identifiable and con- 
trollable, we tend to lump them under the somewhat mystical category 
of “chance ” This so-called “error variance” is now often, and quite 
properly, said to be due, not to “chance,” but to our ignorance and 
impotence If we knev) all and could do all, our experiments with even 
plants and ammals could have the same precision as does the weighing 
of a piece of lead on a mechamcal balance (But then, of course, we 
wouldn’t need to “experiment,” would we^^) 

Although we may think of this view of “chance” as very sophisti- 
cated and modem, it is actually quite old For example, Laplace (1749- 
1827), although one of the founders of modem statistical theory, was 
firm in his insistence upon the umversality of causation For example, 
writing in 1814, he said 

All events, even those which on account of their insignificance do not seem 
to follow the great laws of nature, are a result of it just as necessarily as the 
revolutions of the sun In our ignorance of the ties which umte such events 
to the entire system of the umverse, they have been made to depend upon 
final causes or upon hazard, accordmg as they occur and are repeated with 
regularity, or appear without regard to order, but these imagmary causes 
have gradually receded before sound philosophy, which sees in them only 
the expression of our ignorance of the true causes (Newman, 1956, p 1325) 
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And that other great French mathematician and scientist, Henri 
Poincare (1854-1912), makes the point equally emphatically when he 
says 

We have become absolute determinists E\ery phenomenon, how- 
e\er minute, has a cause, and a mind infinitely powerful, infinitely well- 
informed about the laws of nature, could have foreseen it from the beginning 
of the centuries If such a mind existed, we could not play with it at any 
game of chance, we should always lose 

In fact for it the word chance would not have any meaning, or rather 
there would be no chance It is because of our weakness and our ignorance 
that the word has a meaning for us And, even without going beyond our 
feeble humanity, what is chance for the ignorant is not chance for the scien- 
tist Chance is only the measure of our ignorance Fortuitous phenomena 
are, by definition, those whose laws we do not know (Reproduced from 
Newman, 1956, p 1380 ) 

So we may say, again, that the whole problem of or need for “statis- 
tics” arises because so many situations which we wish to understand 
and control more adequately are, despite our best eflforts, still pretty 
“messy”, and we very much need some means of sorting out, if we 
can, the effect of the independent variable which we have deliberately 
introduced from the effects of variations which are due to other “in- 
dependent” variables or causes over which we have (as yet) no con- 
trol The task is by no means a simple one, and it should not sui prise 
us if we find that in both theory and practice “statistics” is considerably 
less than a finished discipline 

ill Chance (Randomness) as a Psychological Phenomenon 

Since scientific interest in probability theory (on which all statistical 
procedures are admittedly founded) started in the study of games 
of chance, it will be useful for our purposes to scrutinize such games 
with some care There is a common assumption to the effect that the 
element of chance or randomness in such games is somehow inherent 
in the objects — coins, dice, cards, roulette wheels, etc — ^w^hich are 
used for gaming For example, this assumption is repeatedly expressed 
in Levinson’s 1950 book, The Science of Chance 

The com is an inanimate object, and the reason that it is as likely to show 
heads as to show tails is its symmetrical construction, not any choice or 
fancy on its part Now the construction of the coin, which alone determines 
Its behavior, remams exactly the same, whether there have been ten straight 
heads, or ten straight tails, or one hundred straight trials, for that matter 



302 LEARNING THEORY AND THE SYMBOLIC PROCESSES 

On each toss there is always the same chance for heads as for tails (p 34) 

The best ay to grasp this fundamental point — that in tossing a coin the 
chance of heads is exactly equal to the chance of tails, regardless of how the 
preceding tosses have come out — ^is to see that every other theory is absurd 
in Itself and leads to absurd consequences (p 35) 

And later this author stresses the same point in speaking of the 
perfoimance of dice 

In throwing a die it is the symmetrical construction of the die that leads 
us to believe that its sides are equally likely to turn up If the die is “loaded,” 
which means that it is not symmetrical, this is no longer true, as many 
craps players have found out, sometimes a little late Or imagine a die of 
uniform material with six flat sides which are unequal This mechanical 
change has knocked our definition completely out, for there are no equally 
likely cases into which the situation can be analyzed (p 47) 

So, if the source of the variability or chance is inherent in the 
physical object or objects thus employed, the phenomenon would cer- 
tainly seem to be more subject to mathematical than psychological 
treatment But there is another way of thinking about this problem 

As already indicated, the common assumption is that the source of 
randomness in dice throwing or com tossing is in the objects them- 
selves In reading the following passage from a monograph by Ney- 
man (1952), it occuis to one that perhaps we ought instead to look 
for It in the throw 01 toss which puts the object or objects into motion 

We may construct a special machine to toss corns This machine may be 
very strong, driven by an electrical motor so as to impart a constant initial 
velocity to the com The experiments may be carried on m a closed room 
with no noticeable air currents, the coin may be put mto the machine always 
in the same way, and even then I am practically certam that the results of the 
repeated experiments will vary Perhaps very frequently we may get heads, 
but from time to time the coin will fall tails The experimenter may be in- 
clined to think that these cases arise from “error of experimentation” (p 25) 

Neyman uses this illustration, actually, to argue for the irreducible 
reality of “chance,” but what it does more forcibly is to call attention 
to the possibility that if all other elements in the situation w^ere held 
strictly constant, the ultimate reason for variability in outcome would 
have to be traced to slight differences in the intensity of the impulsion 
And from this it would follow that if the magnitude of the impulsion 
could be controlled with sufficient refinement, it might be possible to 
replace the random behavior of a tossed coin with perfect (or at least 
near-peifect) contiol thereof As much is, in fact, implied by Neyman 
himself when he says that, by tightening up on the conditions of ex- 
penmentation, we might be able to get a preponderence of heads, and 
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only a few tails And the occurrence of any tails at all must, of necessitv, 
be due to failure on our part to control the expeiimental situation with 
sufficient precision, ‘‘chance,” it seems, is indeed some “error of ex- 
perimentation ” 

This idea that a perfectly precise (but adjustable) machine which 
flipped a coin or spun a roulette wheel under absolutely uniform con- 
ditions would introduce absolute control and abolish" “chance” may 
be a new one to many readers (as it was to the present waiter) , but "a 
little further perusal of the probability literature show^s that the notion 
has been about for some time For example, it turns out that Poincare 
(cf also Section II) understood all this quite well, and wrote lucidly 
and fully about it 

To find a better definition of chance we must examine some of the facts 
which we agree to regard as fortuitous, and to which the calculus of prob- 
abilities seems to apply, we then shall investigate what are their common 
characteristics 

The first example we select is that of unstable equilibrium, if a cone rests 
upon Its apex, we know well that it will fall, but we do not know toward 
what side, it seems to us chance alone will decide If the cone were per- 
fectly symmetrical, if its axis were perfectly vertical, if it w^ere acted upon 
by no force other than gravity, it would not fall at all But the least defect 
in symmetry will make it lean slightly toward one side or the other, and 
if It leans however little, it will fall altogether toward that side Even if 
the symmetry were perfect, a very slight tremor, a breath of air could make 
It incline some seconds of arc, this will be enough to determine its fall and 
even the sense of its fall which will be that of the initial inclination 

A very slight cause^ which escapes us, determines a considerable effect 
which we cannot help seeing, and then we say this effect is due to chance 
Here again we find the same contrast between a very slight cause, un- 
appreciable to the observer, and important effects, which are sometimes 
tremendous disasters (pp 1381-82) 

The game of roulette does not take us as far as might seem from the pre- 
ceding example Assume a needle to be turned on a pivot over a dial divided 
into a hundred sectors alternately red and black If it stops on a red sector 
I win, if not, I lose Evidently all depends upon the initial impulse I give 
the needle The needle will make, suppose, ten or twenty turns, but it will 
stop sooner or not so soon, according as I shall have pushed it more or less 
strongly It suffices that the impulse vary only by a thousandth or a two 
thousandth to make the needle stop over a black sector or over the follow- 
ing red one These are differences the muscular sense cannot distinguish 
and which elude even the most delicate instruments So it is impossible 
for me to foresee what the needle I have started will do, and this is why my 
heart throbs and I hope everything from luck The difference in the cause 
IS imperceptible, and the difference in the effect is for me of the highest 
importance, since it means my whole stake (Reproduced from Newman, 
1956, p 1383, Italics added ) 
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It IS theiefore of special interest that we differentiate between “games 
of skill” and “games of chance ” A game of skill is one in which special 
talent, motivation, and practice can make a systematic difference in the 
outcome For example, in tennis one can learn to sense (discriminate) 
the difference between a stroke which will send the ball out of the 
court and a stroke that will keep it in The control is, of course, not 
perfect, but it is dramatically better for the experienced player than 
for the beginner By contrast, a game of chance is, by its very nature, 
such that skill avails nothing And the explanation, as implied in the 
passages from Poincare, is based on a well established psychological 
principle, commonly designated as the Weber-Fechner function As 
between two objects of equal size which, however, weigh two ounces 
and three ounces, respectively, a person with normal touch and 
kinesthesis can easily discriminate the heavier from the lighter But 
as between two objects of equal size which weigh, respectively, 19 
and 20 ounces, the individual is quite helpless to make a systematic 
discrimination, although the absolute difference in the weight of these 
two objects IS no greater (namely, one ounce) than the difference be- 
tween the two lighter objects which are perfectly differentiated 

In other words, what the Weber-Fechner law says is that our dis- 
crimination between two sensations is a function of the ratio of the 
difference to the absolute magnitude or intensity of the two sensa- 
tions, rather than of the absolute difference between them And the 
point (or region) beyond which a difference ceases to be discrimmable 
is known as the difference “threshold ” 

Now, to return to games of chance, we can say that they always 
operate in such a way that different outcomes are dependent on such 
small differences in effort that they cannot be perceived, 1 e , fall well 
below the discrimination “threshold,” with a resulting loss of control 
over the outcome With a little practice, one can reach the point that 
he can always make a com fall in a certain way tf he flips it so gently 
that It will turn over, let us say, only three times In other words, a 
person can discriminate between the effort necessary to make the com 
turn over three times and that required to make it turn over two times 
or four times But in coin tossing on which wagers are placed, this type 
of performance is ruled out as “unfair”, and the individual is required 
to make the coin spin 15 or 20 times at the very least Now the differ- 
ence in effort that will mark the difference between heads and tails 
becomes so small that it cannot be discriminated, even by the most 
practiced gamblers The discrimination, and therefore the control, 
is lost “below the threshold,” and the effects or results become rela- 
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tively, if not absolutely, “random ” But this is not because causation 
has ceased to operate, it is simply that, in most life situations, we do 
not need and do not have the capacity for such fine discriminations as 
exact control would here presuppose Thus we “lose control” of the 
performance of the coin, not because of its structural characteristics 
but ourSy and so, if we choose, we may “play” with this phenomenon, 
but we cannot work with it 

At the risk of digressing unduly, it is perhaps also worth noting 
that this view of games of chance may provide an important insight into 
one of the sources of fascination which gambling has for some people 
Even though the winner in a game of chance rationally knows that 
he won “by chance,” still there is a tendency to assume that skill some- 
how got into the situation, and if one can do something w^hich others 
obviously wish to do but cannot (as when one wt?is)y there is un- 
doubtedly a form of “ego income” which goes beyond the purely 
financial gain Perhaps this is why games of chance can be “fun” 
even when betting is not involved — and why habitual gambling is often 
an expression of “neurosis ” 

Now in what has been said in this section, it is not at all implied that 
randomness is exclusively a psychological phenomenon The pattern 
m which raindrops fall is often cited as a good illustration of random- 
ness, which IS certainly completely impersonal, nonpsychological And 
the behavior of genes and atoms provides many more subtle examples 
of a similar kind But since so much inspiration for modern statistical 
methods has been drawn from the games of chance, it is not amiss 
to remind ourselves that we are here dealing with familiar psychological 
principles and are by no means solely in the realm of physics and “pure 
mathematics ” 

IV The Mathematical Approach to Probability and 
the Problem of Statistics 

In the preceding section we have seen that, contrary to a prevailing 
opimon, the phenomenon of randomness in games of chance arises not 

^Levinson (1950, p 41), like various other writers, alludes briefly to the dif- 
ference between games of skill and games of chance, but the most extensive dis- 
cussion of this topic known to the present writer is to be found m von Mises 
(1957, pp 136-138) It may also be pertmendy noted that just as games of chance 
involve a loss of control through a failure of discrimination, the loss of control 
which occurs when behavior is very rapid (see Mowrer, i960, Chapter 12) is 
due to the fact that such behavior “gets ahead” of the sensory feedback there- 
from In both cases, “errors” result, but for different reasons 
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so much fiom the natuie of the objects thus employed as from an in- 
escapable lack of “skill” (sensory acuity) in the mampulation of these 
objects This discovery, illuminating as it is in some ways, does not, 
however, bung us appreciably nearer to a solution to the “statistical” 
problem as defined in Sections I and II 

There is an old saying among scientists that in research you can’t 
lose If, in the course of trying to study one phenomenon, you en- 
counter a difiiculty, you can always turn and study 2t In a sense, this 
is the strategy that has brought the discipline of statistics into existence 
If spontaneous fluctuations in the dependent variable obscure the effect 
of some dehbeiately introduced independent variable, then — for the 
time being at least — let us study spontaneous fluctuations And when 
we do, the first thing we discover is that such fluctuations often 
(though by no means always) tend to be “normally distributed,” i e , 
most specimens will be intermediate or “average” with respect to the 
attribute in question (such as height of wheat plants), with the number 
of specimens decreasing as one moves out toward each of the two 
extremes of the distribution continuum Thus, if Mr Darwin had taken, 
not 15, but 500 ordinary self-pollinated wheat plants and measured 
their heights at a given stage of growth, he would very likely have 
obtained a distribution which approximated the contours of a bell, 
or the so-called normal curve And with this discovery, one is re- 
minded of certain mathematical functions and of the results of various 
games of chance 

If two or more events are, by definition (or by physical arrange- 
ment), equally likely or probable of occurrence (the postulate of 
equally-occurimg events), this fact can be represented mathematically 
by a ratio eg, 1/2 (as in com tossing), 1/6 (as in dice), or 1/52 (in 
drawing any particular card from a standard deck) What the ratio 
means (and this is the mathematical definition of probability) is that if 
there are N possibilities (which are equally likely), the probability of 
the occurrence of any one of these (equally likely) possibilities is i/N 
Thus, if a com (which has two sides and thus two possible ways of 
landing) is tossed, the probability of its falling heads up is 1/2, and 
the very same value, of course, also holds for the probability of its 
falling tails up And since 1/2 plus 1/2 equals i, these two physical 
possibilities are mathematically (and logically) exhaustive Or, similarly, 
if a die (which has six sides and thus six possible ways of landing) 
IS thrown, the probabihty of any one of the six numbered sides “coming 
up” IS supposedly i/6, and six times this fraction equals one, which 
again is logically exhaustive From this way of mathematically stating 
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“simple” probabilities, all manner of more complex probabilities oi 
expectations can be derived For example, the expectation of obtaining 
tzvo heads from two tosses of an “ideal” coin is no longer i /i but i jz x 
1/2 or 1/4, the expectation of obtaimng three heads from three tosses 
IS ifix 1/2X1/2 or 1/8, etc ^ Or the expectation of rolling two sixes 
(or any other two numbers) on a “fair” pair of dice is 1/6 x 1/6 or 1/36 
And It has been found that if all the possible combinations of, let 
us say, heads and tails on 10 successive tosses of a com (or simul- 
taneous tosses of 10 coins) are computed (or actually tested), the 
resulting distribution turns out to be the normal, bell-shaped curve 
already alluded to (precisely, if computation is used, approximately in 
an empirical test) Thus, in pure randomness it is found that there are 
certain lawful relationships, the so-called lanjos of chance^ ^ and so the 
hope of a science of statistics arose and has been applied, among other 
ways, as follows 

From the type of mathematical model here described, it is, of course, 
possible to say just how likely a given outcome is tf “chance alone” is 
operating If, therefore, in a situation wherein an independent variable 
has been deliberately introduced the results are such that they might 
easily be attributed to “chance alone,” then we do not consider that 
anything has been “proved”, but if a result is obtained which would 
be expected only one time in a thousand (P = 001) under “chance 
alone,” then we still do not say that the influence of the deliberately 
introduced variable has been “proved” (the obtained result might still 
have happened “by chance”), but we can say, and with confidence, 
that It would be very unlikely (only one “chance” in a thousand) 
This IS the logic of the so-called null hypothesis, 1 e , the hypothesis 
that the result obtained (for the difference between two, or more, 

® Common logic shows that if a com is tossed twice, there are four possible 
outcomes two heads, a head and then a tail, a tail and then a head, and two tails 
And if the com is tossed three times there are eight possible outcomes HHH, HHT, 
HTH, THH, TTH, THT, HTT, and TTT The general formula which is ap- 
plicable here is, of course, the familiar binomial theorem from elementary algebra, 
(a-l-b)", where “a” represents the chance of obtaining heads on a given trial, 
“b” the chance of obtaining tails, and “n” the number of actual trials 

® “ ‘How dare we speak of the laws of chance^ Is not chance the antithesis of 
all law^’ So says Bertrand at the beginning of his Calcul des probabilities Prob- 
ability IS opposed to certitude, so it is what we do not know and consequently 
It seems what we could not calculate Here is at least apparently a contradiction, 
and about it much has already been written” (Poincare, Newman, 1956, p 1380) Al- 
though individual events are not predictable (“knowable”), the paradox is resolved 
by noting that the so-called laws of chance are based upon “averages” or the be- 
havior of “large numbers ” (Cf also later sections of this chapter ) 
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groups) IS 720t caused by the deliberately introduced independent 
variable but is due entirely to an error or accident of sampling from 
w hat IS really just one (homogeneous) distribution, or ‘'umverse ” So 
what evidence does then, in effect, is not to “prove” some positive 
hypothesis {that is logically impossible because, no matter how good 
the evidence, there is always some room for doubt) but to progres- 
sively “disprove,” m the sense of discredit^ the null hypothesis, le, 
the hypothesis of no “real” (deliberately produced) difference 

Now what has obviously happened here is that we have moved from 
vague, impressiomstic terms such as “favorable” or “very good” (see 
the Darwin experiment) to a precise, mathematical continuum, ex- 
tending from 1 o to oooo^ Thus we can say that if the dependent 
variable in question were not effective, the expectation of obtaimng any 
particular result would be 1/2, 2/33, 7/100, 1/1,000, etc Here we 
have moved from such vague verbal phrases as those just mentioned 
to precise mathematical expressions, which would seem to be a very 
important advance For example, to refer again to the Darwin experi- 
ment, such a procedure permits one to say (after some comparatively 
simple calculations — see Fisher, 1937, p 35 ff ) that the expectation of 
obtaining a difference such as that actually reported between two 
samples of 15 plants if the null hypothesis were true, 1 e , if cross fer- 
tilization did not make any difference m plant vigor, would be 3/100 
or 03 Or, said differently, if chance alone were operating and if 100 

^®This objective of statisucal procedures has been stressed by various writers 
“Galton’s great gift lay in his awareness, which grew during his life, of the vague- 
ness of many of the phrases in which men tried to express themselves in describing 
natural phenomena He was before his time in his recognition that such vague- 
ness could be removed, and a certain precision of thought attempted by finding 
quantitative definitions of concepts fit to take the place of such phrases as “the 
average man,” “variabihty,” “the strength of inheritance,” and so forth, through 
the assembly of objective data, and its systematic examination That the methods 
he himself used were often extremely crude, and sometimes seriously faulty, is, 
indeed, the strongest evidence of the eventual value to the progress of science of 
his unswerving faith that objectivity and ranonahty were accessible, even in such 
elusive fields as psychology, if only a factual basis for these qualities were diligendy 
sought” (Fisher, 1956, pp 1-2, see also Section I) Neyman, in 1952, wrote “The 
objects in a real world, or rather our sensations connected with them, are always 
more or less vague, and smce the time of Kant it has been realized that no general 
statement concermng them is possible The human mind grew tired of this vague- 
ness and constructed a science from which anything that is vague is excluded — 
this is mathematics But the gam in generahty must be paid for, and the price is the 
abstractness of conceptions with which mathematics deals and the hypothetical 
character of the results” (p 23) And Savage (1956) says, quite simply, that sta- 
tistics IS “the art of deahng with vagueness” (p 154) 
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double sets of 15 plants were selected at random, only three of them 
ought to show a difference as large as or larger than the one obtained 
Here we see, once again, that where “chance” is operating, “anything ’ 
ca 72 happen, theoretically, but some combinations of events are much 
more and others much less probable, predictable, expectable 

Thus, It would seem that we have arrived at a highly exact, albeit 
somewhat round-about, means of measuhing causation^ in situations in 
which a given effect is being masked by the action of other concur- 
rently operating causal (“chance”) factors In situations in which the 
“channel” is quiet (to use the language of “information theory”), the 
“message” (from a deliberately introduced cause or “signal”) comes 
through unambiguously, but when there is “noise” in the channel, it is 
much more difficult for the message to “get through,” and it is here 
that the statistical methods just described may help us decide whether 
we have really “heard something” or not Such a service, if it does what 
It purports to, is no small accomplishment 


V Has the "Statistical" Problem Really Been Solved^ 

We can now, it seems, define the fundamental “statistical” problem 
qmte clearly It is the problem that arises when we try to see if one 
variable produces a change in another variable in a situation wheie the 
latter spontaneously changes, or “fluctuates,” due to the action of 
other causal factors which are commonly termed “chance ” It is, how - 
ever, less certain that we have found the solutw 7 i to this problem From 
reading some writers, it would appear that there is not the slightest 
doubt on this score But a more catholic perusal of the literature on 
probability theory and statistics reveals long-standing and continuing 
doubt and reservation Writing in 1878, Charles Sanders Peirce 
evaluated the field thus 

This branch of mathematics is the only one, I believe, in which good 
writers frequently get results entirely erroneous In elementary geometry 
the reasoning is frequently fallacious, but erroneous conclusions are avoided, 
but It may be doubted if there is a single extensive treatise on probabilities in 
existence which does not contain solutions absolutely indefensible (Peirce, 
1878a, p 608) 

That the situation is today not materially improved, despite some 
much-heralded “advances,” is suggested by the following quotations 
Writing in 1956, in an introduction to a paper by Ernest Nagel, New- 
man observes 
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It IS remarkable, as Laplace wrote, that *‘a science which began with the 
considerations of play has risen to the most important objects of human 
knowledge ” But it is in a sense even more remarkable that despite the at- 
tention bestowed on this science, and its enormous influence, mathematicians 
and philosophers are quite unable to agree on the meaning of probability 
Their disagreement is less easily explained than that of the three men de- 
scribing the elephant For in this case the observers are not blind and the 
creature is of their own design (p 1395) 

And in a letter to Dr Henry F Kaiser, under date of May i, 1958, 
Professor L J Savage has said “This is a tough time to be teaching 
elementary statistics, for the state religion seems to be crumbling 
rapidly and the new faith has not yet been hammered out ’’ 

Now we must ask From what sources of difficulty do these ex- 
pressions of skepticism arise^ Among those that appear to be most 
obvious, we can identify the following 

1 The assumption of homogeneity of variance It will be remembered 
that the solution to the statistical problem most widely accepted since 
about 1940 involves a comparison of the results actually obtained, from 
an experimental group and a control group, with the results that might 
be expected if two samples of the same size were drawn from a single 
population in which the “variance” or spontaneous variation is known 
to be “normally distributed ” In other words, starting with a mathe- 
matical model for random variation, we ask what the chances are of 
drawing two separate samples whose mean difference is as great or 

^Not all professional statisticians see this degree of chaos m their field For 
example, Levinson (1950) says “If the theory of chance had grown up to be a 
black sheep in the scientific fold, we might hold the gamblers responsible for 
it and tell them that they should have kept their difficulties to themselves But 
it is not a black sheep It is a well-behaved member of the mathematical family 
and has rendered conspicuous service to many of that large group of subjects to 
which mathematics has been fruitfully apphed Among these subjects are not 
only many sciences, but many busmesses as well, including insurance — one of 
the largest of all” (p 15) Analytical or descriptive statistics is undoubtedly useful 
in helping us see what the data are, but here our concern is rather with inferential 
statistics, which purportedly helps us make practical decisions To the best of the 
present writer’s knowledge, there is no published evidence that we do any better, 
practically, with than without mferential statistics In fact, Bilodeau (1952) has 
shown that in at least one experimental situation human subjects make every bit 
as good decisions without the aid of “significance tests” as they would with them, 
reaching decisions at what would be the 05 to 01 level of confidence (P-value) 
without the aid of any such statistic This appraisal may be unfair to inferential 
statistics, but the Bilodeau study points in the nght direction the value of m- 
ferential statistics should not be taken on faith and needs to be empirically 
demonstrated 
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greater than the mean difference obtained from an actual experiment If, 
as noted earlier, the chances are small — say one in a hundred — of ob- 
taining a difference of this magmtude from two landom samples from 
the same parent population, we are impressed w ith the likelihood that 
the actual difference is due to the influence of the independent variable 
which was deliberately introduced into the experiment, but if this 
likelihood is considerably greater (say, one in five oi one in ten), we 
dismiss the difference as easily due to chance Of course, this reasoning 
involves the assumption that the variance in the population (or popula- 
tions) wath which we are dealing in an actual experiment is also nor- 
mal, 1 e , like that of the mathematical model If it is not — and it often 
IS not, then the justification for the comparison is seriously impugned 

^This point hardly needs extensive documentation Perhaps the following ex- 
cerpt from Hotelhng (1958) will supply all that is necessary “There are indeed 
situations in which valid information about probabilities can be deduced from 
rather broad conditions, as in ergodic theory and in the various limit theorems 
specifying particular forms, such as the normal law for the distribution of func- 
tions of a large number of variates, with an approximation that improves as the 
number of consatuent variates increases These supply some warrant for using 
the normal law as a tentative approximation for particular xariates, but the normal 
law IS often negated by the facts, and in the absence of adequate factual in- 
vestigation the common practice of imputmg a normal distribution to almost 
everything may lead to serious mistakes As in all physical, biological and 
social sciences, we can go some way with theoretical models, but do not remain 
satisfied without observational checks on our deductions at as many points of the 
structure as possible” (p ii) In other words, whenever a statistical procedure is 
predicated on the “normal law,” we must remind ourselves that this law provides 
only a mathemaucal model which does not (as once supposed) correspond to some 
great umversal, unvarying principle but is, rather, created by certam selected 
defimtions (including the assumption of equally-occurring events) Therefore, 
deductions made from these definitions (consututing the model) apply strictly 
and precisely only to data which conform, strictly and precisely, to these defi- 
mtions, and such natural conformity is rare Therefore, as Professor Hotelhng 
properly notes, we must remember that our staastical inferences must be thought 
of as mere “approximations,” which must be empirically checked as closely as 
possible Also useful is his point that data follow the normal law best when, in 
our terms, the number of uncontrolled independent (chance) variables affecting 
the dependent variable is large And this is not always the case in practice Sup- 
pose that the error variance (as opposed to that introduced by the experimental 
V ariable) were due entirely to one or two uncontrolled variables, which operated 
in discrete amounts, quantum-wise Here ordmary tests of significance would be 
totally unwarranted, and to the extent that the assumption of perfect random- 
ness (homogeneity of variance) is not met, to that extent are statistical inferences 
drawn from a model which involves such an assumption questionable, over and 
beyond the element of doubt or uncertamty which is inherent in all statements 
of probabihty (see also Neyman, 1952) 
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In an effort to circumvent this problem, tests of significance have 
recently been introduced which make no assumption about the homo- 
geneity or normality of variance, but these tests — ^the nonparametric 
tests, so-called— are admittedly less sensitive and their justification, on 
other grounds, is still open to doubt (cf Section VII) 

2 Limifaftons of the "null" hypothesis As background foi the discus- 
sion which IS to follow next but, also, because of the inherent impor- 
tance of the problem, let it be noted that although the null hypothesis 
IS the one commonly tested by the “new statistics,” other hypotheses 
are logically possible within the same framework and are also of prac- 
tical interest What a test of sigmficance, as thus far defined, does is to 
tell us (assuming homogeneity of variance) how likely a mean dif- 
ference of the size obtained would be if the two samples were randomly 
drawn from a master population having the characteristics of the postu- 
lated mathematical model In other words, the resulting P-value indi- 
cates how likely the obtained result would be zf the postulated cause- 
and-effect relationship, or hypothesis in question, were not true and ij 
the error variance m the situation were “normally” distributed 

But sometimes this is not what we wish to know Perhaps it is already 
sufficiently evident to direct inspection that there is a “real” difference 
(rather than just a “chance” one) between two means and that what we 
wish to know instead is how much the difference is Now it is pos- 
sible to postulate or hypothesize, not only that there is no “real” 
difference between the two obtained means (the null hypothesis), but 
that there ts a difference and that it is of some specified magmtude 
Then the question becomes If the two samples in question (constitut- 
ing the results from the experimental and the control groups) are, re- 
spectively, from two larger (parent) populations whose means differ 
by the amount specified, what are the probabilities of obtaimng, by 
means of random sampling from these two populations, two compara- 
ble groups whose means differ as much as or more than the means of 
the two actual samples^ 

This hberalization in the type of hypothesis that can be “statistically” 
tested IS undoubtedly an advance in some ways, yet the fact is that these 
developments do not bear upon the problem of homogeneity of vari- 
ance, already alluded to, and, if anything, they even exacerbate the 
problem which will be considered next 

3 Hypothesis "acceptance" or "rejection " a false issue Several genera- 

“For an introduction to the hterature pertinent to the foregoing, see Fisher 
(1956), especially his discussion of “fiducial hmits” (p 5 iff) and “hkelihood 
ratios” (p 66 ff) See also von Mises (1957, p 135 ff) andNeyman (1952, p 229 ff) 
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tions of graduate students, in various disciplines, ha\ e been taught that 
in doing research one must always decide, before collecting any data 
whatever, upon the P-value at which the null hypothesis is going to be 
“rejected” and some alternative positive hypothesis “accepted ” And, 
as a corollary, one must also decide in advance precisely how many 
subjects (observations) are to be involved in the experiment (see Para- 
graph 4) Thus, It was reasoned, the investigator is protected against the 
danger of simply running subjects until, through random fluctuation, he 
gets a P-value which “suits him,” and then stopping Having, in other 
words, set in advance both the P-value at which the null hypothesis is to 
be “rejected” and the number of subjects to be used, the experimenter 
is presumably prevented from, consciously or unconsciously, “fudging ” 
Now, on the face of it, this seems like a high, moral principle But 
It does not stand scrutiny and many detailed arguments can be ad- 
vanced against it, which come to focus in the following incident A 
few years ago the writer participated in the final oral examination of a 
Ph D candidate (in another department) who, along with thousands of 
other graduate students, had been trained to believe that in research you 
must always set the criterion of “sigmficance” for your results in 
advance of doing an experiment Therefore, in the summary of his 
findings, this student had dutifully written, “The results of this experi- 
ment provide no basis for beheving that the hypothesis in question is 
true ” The fact was that the results provided quite a lot of “evidence” 
in favor of the hypothesis, but because the student had in advance set a 
P-value of 05 and actually obtained a P-value of 07, he was compelled, 
by this singular logic, to report ^^720 evidence ” How much better it 
would have been if this man had simply carried out his experiment, 
reported whatever P-value he obtained, and then let the reader make 
whatever use of this information he saw fit 

For some purposes a P-value of 07 is quite sufficient, whereas for 
other purposes one may wish to insist upon a P-value of 01 or even 
001 And It would seem obvious that since a researchei cannot foresee 
all the varied circumstances in which his findings may be relevant, he 
has no right to prejudge the case Editors of scientific journals may, if 
they wish, set a policy of not publishing experimental results which do 
not meet some specified level of “sigmficance” (eg, the 05 level), 
but we should be quite clear that such a policy represents a practical 
(and perhaps entirely justified) decision and not a sacred dividing line 
between abstract truth and error, or evidence and “no evidence ” 

4 "Sfafisfics" and the problem of decision A few months ago the 
writer participated in the training of a group of educators — ^principals, 
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teachers, and school-board members — in research and statistical meth- 
ods that might be applicable to problems commonly encountered in 
primary and secondary schools And at one point he asked the members 
of the group what service or function they expected statistics to per- 
form for them The reply given by one person (with nodded assent 
from a number of others) was memorable She said ‘‘We want statistics 
to tell us what to do ” Most specialists in the field now cringe when 
they hear this sort of statement, but it was not long ago that this inter- 
pretation was at least implicitly advocated m our leading textbooks 
When the logic of the null hypothesis was at the height of its popu- 
larity, the scientific investigator was counseled as follows First you 
decide upon the P-value at which you will re'ject the null hypothesis, 
and if this value is reached or exceeded in actual experimentation, your 
mind is, so to say, automatically “made up” for you you have “proved” 
the alternative hypothesis and must presumably now act upon it in 
whatever way is relevant to the practical situation But, as we have 
already seen, “circumstances alter cases,” and what is sufEcient evidence 
for one decision may not at all be sufficient for another, and it clearly 
exceeds the investigator’s right and responsibility to try to fix a deci- 
sion point in advance of expeiimentation to control all contingencies 
(see also Section VI) 

In other words, “truth” is a relative matter, in two ways (i) it is 
relative in the sense that it is never absolute, i e , the evidence at our 
disposal IS always partial, incomplete, and therefore our judgments, 
if wise, always have some measure of tentativeness or uncertainty about 
them, and (2) it is relative because evidence that is “true” (good 
enough) for one purpose may not be at all sufficient for another This 
is not to say, of course, that the ultimate principles according to which 
the Umverse functions are unrehable, indefinite, or variable, the point 
is that our hiowledge of these principles, based as it is upon limited 
observation, is partial and (ideally) tentative — and that decision and 
action will vary, not only as a function of the degree of our conviction 
or doubt (based on the evidence), but also as a function of the magni- 
tude of the danger, or risk, that would be involved (subjectively) if we 
made a mistake, a mis judgment Whether we like it or not, we are there- 
fore concerned here, not only with epistemology (the problem of 
knowledge, or cognitive learmng) but also with value theory and the 
problem of choice (affective learmng) And the notion that we can, by 
statistics or other “purely objective” methods, arrive at the ultimate 
(absolute) truth and therefore make infallible decisions is an illusion 
The orgamsmic, or psychological, element can, without question, be 
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somewhat “reduced” or “standardized”, but it cannot, in the final analy- 
sis, be eliminated (cf Nagel, 1955) 

5 Level of significance and number of subjects The final difficulty y ith 
w hich we shall here be concerned is not a particularly subtle one, yet 
It has been slow to gam general recogmtion In many situations it is 
found that the difference between a “reliable” and an “unreliable” dif- 
ference bety^een the experimental and control group means depends 
upon the number of subjects (or specimens) used, so that the investi- 
gator, if of a mind to, can determine in advance whether a hypothesis 
will be accepted or rejected (at some predetermined “level of con- 
fidence”) by the simple expedient of runmng relatively many or rela- 
tively few subjects Suppose, for example, that the independent varia- 
ble which IS under investigation makes a real but slight difference in 
the dependent variable Now statistical formulae being what they are, 
the larger the number of subjects used m the two groups receiving 
different treatment m an experiment, the greater the likelihood of ob- 
taimng a difference that is “reliable” at some specified P-value There- 
fore, if one wishes to discredit a given hypothesis, all one needs to do is 
to run a number of subjects which would be “reasonable” if dealing with 
a more potent variable but not sufficient to produce an “acceptable” 
P-value in the present case, and, by the same token, if one is particu- 
larly intent upon supporting a given hypothesis, a causal relationship 
(if present at all) can be substantiated if one deals with very large num- 
bers of subjects (see Bolles & Messick, 1958, also Section VII) 

Obviously this difficulty, taken in conjunction with the others re- 
viewed in this section, constitutes a major weakness in the theory and 
application of the newer and supposedly definitive statistical pro- 
cedures 


VI Statistics, Decision Theory, and Ordinary Choice 

In their book Decision Processes, Thrall, Coombs, & Davis (1954) 
remark 

Any system may be a “model ” It may, for instance, m some remarkable 
case, be only a model for itself In general, the same system may provide a 
model for many other systems in bemg a realization of each either under 
“interpretation” or “abstraction” Thus “mathematical model” here 
means simply “formal deductive system”, a mathematical model together 
with a given interpretation of the model in the “real world” constitutes a 
“theory,” while “real world” itself is a term intended to denote what- 
ever your form of epistemology will buy (p 6) 
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Now if our discussion up to this point establishes anything with 
clarity, it is that the ‘‘model” on which most statistical tests of sig- 
nificance are based, while purporting to provide “a model for many 
other systems,” in point of fact comes perilously close to being “only 
a model for itself ” In the preceding section we have seen how ques- 
tionable is the assumption of homogeneity of variance with respect to 
actual, empirical data, and even in games of chance, where the assump- 
tion IS most nearly met, some discrepancy is to be expected, on both 
empirical and theoretical grounds In a classical experiment with dice, 
W F R Weldon (cited by Yule, 1919, p 258) threw 12 dice 4096 
times and found that although the results approximated those predicted 
by the “laws of chance,” they did not by any means conform perfectly 
(Fig 8~i) And Bolles & Messick (1958) argue as follows 

Might not the null hypothesis always be rejected if sufficiently powerful 
significance tests were used^ Even m the classical situation with a tossed 
coin, are there ever any really unbiased coins, or are all coins in real life 
smoother or heavier on one side than on the other ^ [Cf also Section III ] 
If the null hypothesis might, m fact, not be exactly tenable, especially when 
continuous measures are used, then what about the theory of significance 
tests^ An extreme expression of skepticism has been recently summarized by 
Savage (1957), who asserts that “Exclusive reliance on tests of significance 
obscures the fact that statistical significance does not imply substantive sig- 
nificance Null hypotheses of no difference are usually known to be 
false before the data are collected, when they are, their rejection or accept- 
ance simply reflects the size of the sample and the power of the test, and is 
not a contribution to science” (p 223) 

Thus has there arisen the surmise that, even after the most careful 
statistical treatment and interpretation, data which are contaminated 
to begin with (see Sections I and II) remain contaminated and that 
conclusions with respect to them must be drawn with double cau- 
tion (a) caution arising from the very nature of probabihty, even as 
mathematically idealized (in models), and (b) caution prompted from 
recogmtion of the almost certain discrepancy between mathematical 
models and the “real world ” The result, quite naturally, has been a 
shift in interest on the part of many investigators from statistical tech- 
niques as such to what is now generally (and somewhat pretentiously) 
termed decision theory Gradually it has been realized that statistical 
procedures cannot “tell us what to do” (cf Section V-4), that doing 
presupposes deciding^ and that deciding is contingent not only upon 
the available evidence but also upon the nature of the risks (of gam 
and loss) , or values, which are involved 

Edwards (1954) has cogently pointed out that “Economists and a 
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Fig 8-T Two curves showing the relationship between the theoretically expected 
and the obtained frequencies in a dice-throwing experiment carried out by Weldon 
(reported by Mills, 1924, p 525) The somewhat angular contour of the cur\e 
representing the theoretical frequency of various combinations on the dice is de- 
termmed by the fact that a finite number of dice (12) were involved in each 
throw If a very large or infinite number of dice had been used, the curve would 
be smooth, bell-shaped The results actually obtained closely approximate but do 
not exactly match the theoretical (mathematical) expectation A “success,” it 
should be said, was counted in this experiment whene\er a 4, 5, or 6 spot came 
up on a die, i, 2, and 3 spots were not counted Thus, on any given throw, it 
was possible to obtain anywhere from o to 12 successes (the extremes being repre- 
sented by a 4, 5, or 6 spot showing on none of the 12 dice and by a 4, 5, or 6 spot 
on all of them) The most commonly expected occurrence would, of course, be 
SIX dice showing successes or counters and six dice showing noncounters 


few psychologists have produced a large body of theory and a few 
experiments that deal with individual decision making” and that “This 
literature is almost unknown to psychologists, in spite of sporadic 
pleas in both psychological and economic liteiature for greater com- 
munication between the disciplines” (p 390) The reluctance of con- 
temporary psychologists to face the problem of decision making un- 
doubtedly has Its roots in Behaviorism, for this conception of psy- 
chological science held that nothing so subjective and “internal” as 
choice and “will” was to be countenanced, and it would have fitted 
very mcely into the general behavioristic plan and strategy if we could 
have passed the whole process of decision back upon something as con- 
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vemently objective and impersonal as a statistical formula But this has 
not proved possible, and the current effort to shift the problem from 
“statistics” to “decision theoiy” represents a last desperate effort to 
retain the fiction of objectivity and impersonality This struggle is 
rather wistfully imphed m the following quotation from Wallis & 
Roberts (1956) 

Decision theory in this broad sense is not yet ready for practical applica- 
tion, except perhaps in special circumstances The term “decision theory” 
has, of course, great appeal, for everyone has to make decisions, and every- 
one hopes for some magic formula by which to make them, as a result, more 
has sometimes been claimed for decision theory than it can yet produce in 
practice Already, however, decision theory has resulted in clarification of 
the standard significance testing procedure That is, it illuminates the nature, 
uses, and limitations of significance tests (p 385) 

Thrall, Coombs, & Davis (1954) and their collaborators, while vig- 
orously pursuing the search for mathematical models for the “decision 
processes,” nevertheless frankly recognize the clearly psychological 
dimensions of the problem And the analysis has been pushed still 
further along these lines by Feather (1959) m an article entitled “Sub- 
jective Probability and Decision Under Uncertainty ” We cannot here 
be concerned with the details of this article, but its over-all objectives 
are so clearly stated in the author’s introduction and are so pertinent 
to present considerations that this part of the article will be quoted in 
Its entirety 

In this paper it is intended to review generally five approaches which relate 
to the analysis of behavior in a choice situation where a decision is made be- 
tween alternatives havmg different subjective probabilities of attainment 
The present discussion is mainly concerned with the way in which the con- 
cept of subjective probability has been mcorporated into each model 

The five contributions to be reviewed are (a) the Lewin, Dembo, 
Festmger, and Sears (1944) analysis of level of aspiration behavior, (b) Tol- 
man’s (1955) discussion of the principles of performance, (c) Rotter’s 
(1954) basic equation in his social learning theory, (d) Edwards’ (1954, 
1955) discussion of the SEU model from decision theory, and (e) Atkinson’s 
(1957) risk-taking model 

The remarkable fact about these five approaches is their similarity with 
respect to concepts employed and equations advanced Recently Siegel 
(1957) noted the close similarity between the level of aspiration analysis 
by Lewin et al (based on the earlier work of Escalona [1940] and Festmger 
[1942] and the SEU decision model) The first mam aim of this paper is to 
show that the parallel may be taken further to mclude the analyses by Tol- 
man, Rotter, and Atkinson This parallel is all the more mterestmg and sig- 
nificant m that these models have developed from different areas of research 
Lewin et al are concerned with goal-setting m the level of aspiration situa- 
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non, Tolman’s analysis is related to animal experimentation, Rotter's social 
learning theory is applied to climcal problems, the Edwards SEU model 
relates to research m decision theory, and Atkinson is concerned with the 
effect on risk-taking behavior of mdividual differences in motive strength 
It w ould appear, then, that interpretations of research from di\ erse areas are 
converging upon a similar type of model 

Despite this parallel, however, there is a discrepanc\ in the wa> in w^hich 
subjeeme probability is included m the different analyses The second main 
aim of this paper is to bring this discrepancy to light The discrepancy con- 
cerns whether or not concepts which are akm to utility in the various models 
are taken to be vndependent of subjeeme probability In other words, are 
utilities, valences, reinforcement values, and similar concepts related to 
subjective probability in these models, or are they assumed to be indepen- 
dent^ It wdl be argued that this question can be approached experimentallv, 
and an experimental study (Feather, m press) testing hypotheses, derived 
from assumptions about the effects of past learning on behavior in choice 
situations, will be outlined m an attempt to resolve some of the disagreement 
(P 150) 

The reader who may have been very much “at sea” m earlier sec- 
tions of this chapter will now begin to recogmze some familiar land- 
marks The problem of decision making obviously articulates with 
the contents of Chapters 6 and 7, and anyone who is also familiar with 
Learning Theory and Behavior (Mowrer, i960) will recogmze almost 
all of the writers referred to in the passage just quoted from Feather 
Here, m order that the reader may feel even firmer ground beneath 
him, let It be recalled that the whole thrust of revised two-factor learn- 
ing theory has been to re-introduce the problem of choice (where it 
had been quite abolished by the reflexology of Pavlov and the stimulus- 
response “bonds” of Thorndike), to show that hopes and fears (which 
are the dynamic conditioners of choice) themselves imply not only 
“probabilities” (cf Chapter 9) but also the nature and magmtude of 
risks (promises and threats), and to provide, generally, a conceptual 
and explanatory framework of scope and power However, our jour- 
ney is not yet at an end and we must push on through some more un- 
explored — and “rugged” — territory 

VII Causation and Correlation 

This chapter is predicated on the assumption that in science we are 
mainly concerned with the discovery of cause-and-effect relation- 

The reader who wishes to explore the literature on this general subject more 
thoroughly will find that Wasserman & Silander (1958) have pubhshed a very use- 
ful monography, “Decision-Making An Annotated Bibliography” And for a dis- 
cussion of theory, see Jams (1959) 
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ships But, as we quickly found, the perception and interpretation of 
such relationships is often obscured (a) by the phenomenon of con- 
founding, which (happily) can nearly always be eliminated by ap- 
piopiiate experimental design, and (b) by random (as opposed to sys- 
tematic) errors, which “statistics” supposedly helps us deal with And 
the discussion thus far has been largely concerned with the ques- 
tion of w hethei and to \\ hat extent this latter supposition is, in fact, 
valid 

Our conclusions must be tentative, but the moral of our discussion 
up to this point seems to be as simple as it is painful Despite tremen- 
dous effort and ingenuity, the statistical problem is still very far from 
having an elegant mathematical solution, and it may even be doubted 
that such a solution is, in principle, possible The task which modern 
statistical inquiry has set for itself may be likened to that of devising a 
means for making a meaningful signal, which is transmitted over a noisy 
communications channel, more intelligible without reducing the noise/ 
signal ratio B F Skinner (1938) has long since abandoned statistical 
analysis and sought to improve the “clarity” of experimental findings 
in learning research by gaimng better control over irrelvant variables 
and thus reducing spontaneous variations in subject performance His 
contention is, in effect, that regardless of the mathematical transforma- 
tion employed, contaminated data are still contaminated and that the 
only way to draw sound inferences is to insist upon clear-cut raw data 
(cf Mowrer, i960, Chapter 8) 

But perhaps we have not given the statistical approach a fair trial 
Perhaps there are other possibihties that have not yet been examined 
As far as the now conventional “tests of sigmficance” are concerned, it 
would seem (if our preceding analysis has been sound) that we are near- 
ing the “end of the line ” But imbedded in the common language used 
m our discussion is an intimation that is well worth noting Almost 
synonymously, we have used the terms, causation, connection, associa- 
tion, and correlation And there is a well developed literature on statisti- 
cal methods of dealing with “correlation” which, in point of fact, con- 
siderably antedates the work on “significance tests ” Therefore, let us 
turn back to an older book, such as that of Mills (1924), and re-examine 
this area of statistical development This author begins his discussion of 
correlational techmques by asking the following question 

If It IS possible m dealing with time series [discussed by Mills in earlier 
chapters] to secure a definite mathematical equation for the relation between 
time and the normal values of the items m a given senes, cannot the same 
device be employed in studying the relationship between other variables^ 
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Can we not measure, mathematically, the relation between cotton production 
and the price of cotton, between corn yield and rainfall, betw^een earnings 
and the output of labor^ If this can be done, it will place in the hands of the 
economist a very powerful tool, giving his methods something of the pre- 
cision which attaches to the work of the physical scientist (pp 363-364) 

And as a further example, Mills reproduces data on “taxable per- 
sonal incomes and motor vehicle registration m forty-three states, 1921” 
in tabular form, which he then translates into the scatter diagram shown 
in Fig 8-2 At first blush, these data seem to be very different from 



Fig 8-2 A simple scatter diagram, or correlauon chart, reproduced from Mills 
(1924, p 366) A so-called coefficient of correlation is a single value, ranging from 
00 to -fi o or —10, which indicates how precise or close the association or co- 
relation between two variables is If the correlation is perfect (and “linear’’), all 
values he along a straight, diagonal (ascending or descendmg) line (as is the case, 
for example, of the weight of an object and the distance it causes the pointer 
on a good set of scales to move) The line shown m the above figure is given 
only as an approximaaon of the trend shown in the actual data The coefficient 
of correlauon for the data in this exhibit is 935 

the Darwm-Galton data, but further analysis will show some very 
fundamental similarities In both cases there are two major variables 
the independent variable or cause (mode of pollination, number of 
taxable personal incomes) and the dependent variable or effect (plant 
vigor, incidence of motor cars) But, it can be objected, in the Darwin 
experiment there were only two values for the independent variable 
(self-pollination and cross-pollination), whereas m the Mills example 
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the independent variable is continuous (taxable incomes of nothing to 
$400,000) However, even this difference can be minimized if w^e 
note that the Mills data mighty if we wished, be limited to just two 
values for the independent variable, let us say states with 5,000 to 10,000 
taxable incomes and states with 50,000 to 60,000 taxable incomes (Or 
smaller ranges could be used if such a procedure did not too seriously 
attenuate the data) Here the situation would be essentially the same 
as in the Darwin experiment, but since we have a lot more ‘informa- 
tion” in this situation than Mr Darwin had in his, we might as well use 
all of It if w^e can Therefore, w^e will permit continuous variation in the 
independent variable and will return again to the scatter diagram As 
Mills observes 

It IS clear from this diagram that there is a relationship between the tw o 
\ariables [indicated by the upward slope of the line] In general, the states 
with a large number of taxable personal mcomes are also those having a 
large number of motor vehicles The relationship, however, is not perfect 
Thus both Kentucky and Oklahoma had 69,000 taxable personal incomes in 
1921, yet the former had 126,000 motor vehicles registered, while the latter 
had 221,000 Were the relationship perfect a single value of the Y-variable 
[motor cars] w-ould always be paired with a single variable of the X-vanable 
[number of taxable mcomes] (p 364) 

We therefore face the same problem that existed in Mr Darwin’s 
data In other words, if the value of the dependent variable was always 
the same for a given value of the independent variable, the causal rela- 
tionship, connection, or correlation would be perfect, it would be 
obvious to ordinary inspection, and there would be no “statistical” 
problem But in both situations it is clear that factors other than the 
stipulated independent variable are affecting the dependent variable, 
so that an element of ambiguity is present in both cases Although it 
seems unlikely, it is still conceivable that, the world-over (or through 
time), there is no real relationship between high incomes and prevalence 
of motor cars and that our sample is in some way a biased one, reflect- 
ing an “error of sampling ” Therefore, basically the same questions of 
reliability and sigmficance arise as exist in ordinary experimental situa- 
tions Mills epitomizes these questions as follows 

A mathematical expression has now been secured for the relation between 
the two variables being studied, the number of taxable personal incomes, by 
states, and the number of motor vehicles registered The former is the mde- 
pendent or X-variable in the equation, the latter the dependent or Y-variable 
This equation constitutes a measure of the functional relationship between 
these two variables, but it is only an expression of average relationship How 
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significant is the equation^ If the relationship were perfect, and the plotted 
points all lay on the line describing this relationship, the equation could be 
used with confidence as an accurate instrument for determining the \ alue of 
one variable from a value of the other But a line w ith a definite equation 
may be fitted to points which depart \ery widely from it, w hich are widely 
dispersed In such a case the equation may have the appearance of describing 
a precise relationship but the variation is so great that it cannot be used w ith 
confidence It is the same problem as that which arises w^hen an average is 
employed We must know how significant the average is, how great the 
concentration about it, before we may use it intelligently So the equation of 
relationship between variables means little unless we know to w^hat extent it 
holds m practical experience We must have a measure of the dispersion 
about the Ime we have fitted 

In describing the frequency distribution, it has been found, the standard 
deviation is the best general measure of the variation It is, obviously, the 
measure we need in determimng the reliabihty of the equation of average 
relationship The standard deviation about this Ime will not only serve as a 
general index of the significance of this equation but will enable us to 
measure the degree of accuracy of estimates based upon the equation (pp 
367-368) 

For our present purposes, we have now pursued this argument far 
enough We see that conventional correlational procedures, in prac- 
tice, run into exactly the same difficulties as are encountered when we 
attempt to deal with ‘‘averages” and that basically similar statistical 
devices have been suggested for deahng with them Therefore, if we 
have found these devices less than thoroughly satisfactory for dealing 
with the problem of averages, we question them equally in the con- 
text of correlation 

But now appears an article by Bolles and Messick (1958) entitled 
“Statistical Utility in Experimental Inference,” in which a new tack is 
made on this old problem The authors begin by saying 

The majority of statistical procedures carried out in conjunction with 
psychological research are tests of significance Typically, the researcher 
wants to know whether his data reflect a “real” difference between control 
and experimental groups, or whether the observed difference could have 
arisen by chance Two points may be brought out one is the concept of 
power and the other concerns the distinction between real and chance dif- 
ferences A powerful test is one which gives a high probabilitv of claiming 
a real difference when one actually exists in the population Since the re- 
searcher is mainly concerned with findmg real differences, he uses the most 
powerful tests at his disposal (p 223) 

There then follows the expression of dissatisfaction with present tests 
of sigmficance which has already been quoted, in Section VI, after 
which the authors say 
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The polemical point of this paper is that the fundamental obligation of E 
IS to account for \ ariation, obtammg significance differences is only incidental 
to his task of controlling, predicting, and evplaimng (p 224) 

To summarize so far, there are tw o properties of significance tests w hich 
limit their usefulness in psychological research (a) they are dependent upon 
the poy er of the test in general and the sample size in particular [see Section 
V-5], (b) the empirical situation of controlled and uncontrolled variables 
does not precisely correspond to the statistical inference model yhich in- 
yohes real and chance effects [Section V-i] Thus, the null h\pothesis mav 
or may not be true in the model, but m empirical situations, except under 
the conditions noted aboye, and possibly \^hen crude discrete measures are 
used. It IS almost certainly false It would seem, then, that an index of utilit\ 
IS called for which can be used to supplement significance tests In this con- 
nection w^e propose the label “coefficient of utility” for the class of statistics 
which describe the partitioning of variance (p 225) 

The interested reader can consult the Bolles-Messick aiticle in the 
original for the details of the exact method employed, but what is per- 
tinent here is the fact that it is based upon a correlational procedure 

Equation 3 means that U can be interpreted in terms of the correlation 
between the independent and dependent variables Such a correlation is 
analogous to the biserial correlation m that it is dichotomous for one variable 
U IS also closely related to Fisher’s inter-class correlation and to Kelley’s un- 
biased correlation ratio (p 226) 

It should be noted that the concept of statistical utility is applicable to non- 
normal populations and may be used to supplement non-parametric signifi- 
cance tests (p 226) 

The author is not competent to evaluate the Bolles-Messick method 
from a technical standpoint, but it is obvious that this method is cen- 
trally concerned with exactly those problems which have held our at- 
tention in preceding sections and is also congruent with oui supposi- 
tion that causation is basically a matter of correlation, association, con- 
nection And with this point now apparently well established, we turn 
to what may be regarded as the second half of our discussion of this 
general topic, which will be continued in the next chapter 




Learning, Causality, Probability, 
and Statistics (continued) 


In the pieceding chapter we have seen that the efforts to handle the 
“statistical” problem by means of tests of significance have encountered 
serious difficulties, that it is too early to tell how far the Bolles-Messick 
“coefficient of utility” may deliver us from these difficulties, and that, 
in any case, there is growing interest in “decision theory,” which brings 
psychological processes more directly into the picture than they have 
previously been In this chapter we shall therefore look at the problem 
from a frankly psychological standpoint — ^more specifically, that of re- 
vised two-factor learning theory — and see what new perspectives or 
insights can thus be gained 

I Learning and Causation 

Some years ago the author gave a seminar jointly with I A Richards, 
in the course of which Professor Richards conjectured that learning, 
when finally understood, would turn out to be related, perhaps rather 
closely, to the phenomenon of causality And if one pursues the point, 
one discovers that, although largely neglected by contemporary learn- 
ing theorists, this relationship was discussed by David Hume, with 
clarity and penetiation, more than two hundred years ago In his 
Treatise of Human Nature (1738), Hume approached the problem as 
follows 

The qualities, from which this association [of ideas] arises, and by which 
the mind is after this manner convey’d from one idea to another, are three, 
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VIZ , Resembla?2ce, Contigimy in time or place, and Cause and Effect (p 319) 

Tis sufEcient to observe, that there is no relation, which produces a 
stronger connexion m the fancy, and makes one idea more readily recall 
another, than the relation of cause and effect betwixt their objects (p 320) 

Hume’s language is different from that usually employed today, but 
the translation is not difEcult “Resemblance” is presumably what we 
now term generalization (on the basis of similarity, see Mowrer, 1960, 
Chapter 12), and contiguity refers to the conjunction of stimuli which 
constitutes the familiar paradigm of conditioning But what of cause 
and effect^ 

A few days ago the furnace in the writer’s home was being repaired, 
and one of the workmen suddenly stepped back and jostled an orna- 
mental bird cage which was hanging on a tall metal stand The stand 
and cage started to fall, and the writer called out a warmng, but it was 
too late for the workman to catch them and they crashed to the floor, 
breaking a part of the cage The workman’s ill-considered movement 
caused the pedestal to fall, and the fall caused the cage to break 

Now a knowledge of causal relationships is obviously important to 
living orgamsms, since it enables them to prepare for events in advance 
of their occurrence, or to interrupt or precipitate them So the ques- 
tion arises as to whether our theory, which reduces all learmng to con- 
ditiomng, IS able to account for learmng of this particular land Causa- 
tion is commonly stated in terms of if-this, then-that If the workman 
bumps the stand, with sufficient force, it and the cage will fall If the 
cage falls, it will (probably) break Here there is always a sequence of 
two events^ so-called cause and effect, and we immediately perceive 
the possibility that the cause (coming first) may function as a con- 
ditioned stimulus and the effect (or consequence) as the unconditioned 
stimulus Damage to a valuable object usually evokes a reaction of dis- 
may, and the fact that the writer cried out when he saw the pedestal 
and cage falling suggests that he was, in fact, conditioned to react to 
falling objects much as one does to the object after the fall ^ 

If this analysis is valid, then the conditioning process is well suited 
to capture the essence of cause-and-effect relationships We are, in 
fact, already quite accustomed to think of an unconditioned stimulus 
as an effect^ a consequence, an outcome, a remforcer (positive or nega- 

^From a high-school Enghsh class the writer recalls a piece of drollery en- 
titled, “Darius Green and His Flymg Machine” After his machine had crashed, 
Darius was asked how he hked the fall His reply was that the fall was pleasant 
enough but that he had not enjoyed the landing Thus, falling presumably qualifies 
as “an imtially neutral stimulus” which, however, becomes fear-arousing because 
It is so likely to be followed by mcremental reinforcement, or pain 
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tive) If this, then thatf But the notion of a cause, i e , the this, ser\ing 
as a conditioned stimulus is more novel — and perhaps doubtful At once 
one will think of many conditioned stimuh which manifestly are not 
causes or causal One would hardly say that a ticking metronome, in 
a Pavlovian experiment on salivary conditioning, causes the food to 
appeal or that a buzzer which warns a rat of impending electric shock 
causes the shock These are signs, we say, not causes But, as we have 
seen, a sign may also be a cause Thus we arrive at the conclusion that 
the causal relationship, as psychically apprehended, is a special case of 
the more general phenomenon of conditioning or learning by con- 
tiguity All causes, when they are known, act as conditioned stimuli, 
but not all conditioned stimuh are causes, and contemporary psy- 
chologists have largely overlooked the special case for the reason that 
m laboratory studies the relationship between CS and UnCS is nearly 
always arbitrary rather than necessary There is, however, no reason 
to doubt that conditioning would occur quite as readily in the one case 
as m the other One could easily arrange a situation in which the ticking 
of a metronome would, in fact, cause food to appear or, equally, the 
sound of a buzzer cause shock to come on The expenmenter himself 
IS, of course, very much interested in discovering necessary or causal 
sequences (what causes or controls what), but his tacit assumption that 
his subjects have no such capacity or interest has blinded him to the 
full scope and imphcation of the learmng process ^ 

Arbitrary signs and true causes are, of course, in practice often very 
much alike, especially if one uses them merely in preparing for the in- 
evitable, as for instance with respect to the weather There used to be 
(perhaps still is) a saying in the rural area of North Missouri where the 
writer lived as a child to this effect “Evening red and mormng gray 
sends the traveler on his way, but evening gray and mormng red brings 

® An exception to this general neglect of the causal relationship is the work of 
Michotte (1946), which recently inspired Gruber, Fmk, and Damm (1957) to 
perform an ingenious experiment on what they call the “perception of causahty ” 
They say “The stimulus event was the collapse of a ‘bridge’ following the re- 
moval of one of Its vertical members A very definite and striking impression of 
causality is reported if the time between the removal of this upright and the 
collapse of the bridge is sufficiently short As the time interval increases, S reports 
such an impression less and less frequently” (p 89) Here removal of the support 
may be thought of as the CS and the collapse of the bridge as the UnCS, and such 
an interpretation is strengthened by the finding that as the interval between these 
two events is increased, the “impression of causahty” — conditioning^ — decreases 
(cf Mowrer, i960. Chapter 10) When two such events will be perceived as 
causally related and when not (aside from the question of temporal relationship) 
will be explored in the paragraphs which follow 
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ram upon the traveler’s head ” Clearly, a gray evening (cloudy sun- 
set) IS here regarded as a s/gn of ram, but is it also a cause thereof^ 
Actually it is dijSicult to know, and one readily sees why primitive 
peoples were often confused about signs and causes and why the dis- 
tinction between superstition and magic, on the one hand, and more 
rational beliefs and practices, on the other, was often vague m their 
minds Perhaps by means of smoke or steam, which would make the 
sunset “gray” (or cloudy), one could make it ram’ Only in those areas 
where natural signs can be reproduced by human intervention do we 
quickly discover the distinction between signs which are truly causal 
and signs which are not Otherwise, as is generally true of “the 
weather,” observation and inference of a much more detailed and subtle 
kind is required — and, even then, our understanding of the situation 
may not be very precise 

[[ David Hume on Causality and Learning 

Having m the preceding section quoted Hume and having then 
shown how much further an analysis of the cause-and-effect relation- 
ship can be carried, let us allow Hume to speak again for himself 

The idea, then, of causation must be deriv’d from some relation among 
objects, and that relation we must now endeavour to discover I find in 
the first place, that whatever objects are considered as causes or effects, are 
contiguous^ and that nothing can operate in time or place, which is ever so 
little remov’d fiom those of its existence Tho’ distant objects may some- 
times seem productive of each other, they are commonly found upon exami- 
nation to be link’d by a chain of causes, which are contiguous among them- 
selves, and to the distant objects, and when in any particular instance we 
cannot discover this connexion, we still presume it to exist We may there- 
fore consider the relation of contiguity as essential to that of causation, at 
least may suppose it such, accordmg to the general opmion, till we can find 
a more proper occasion to clear up this matter, by examining what objects 
are or are not susceptible of juxtaposition and conjunction (pp 377-378) 

Having thus discover’d or suppos’d the two relations of contiguity and 
succession to be essential to cause and effects, I find I am stopt short, and 
can proceed no farther in considering any single instance of cause and effect 
Motion in one body is regarded upon impulse as the cause of motion in 
another When we consider these objects with the utmost attention, we find 
that the one body approaches the other, and that the motion of it precedes 
that of the other, but without any sensible interval ’Tis in vain to rack our- 
selves with further thought and reflection upon this subject (p 379) 

Hume here shows a mce understanding of the gradient of reinforce- 
ment according to which conditiomng weakens as the temporal in- 
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terval between CS and UnCS mcieases (see footnote 2), and he is also 
quite explicit in noting, as we also have been, that cause-and-efFect is 
not a distinct phenomenon, psychologicallv, but a special case of learn- 
ing by contiguity But perhaps Hume did not see the distinction be- 
tween conditioned stimuli which are causes and those which are merely 
signs^ Immediately following the passage last quoted, he says 

Should any one leave this instance, and pretend to define a cause, by sav- 
ing it is something productive of another, ’tis e\ident he would say nothing 
For what does he mean by productive^ Can he give am definition of it, 
that will not be the same with that of causation^ If he can, I desire it ma\ be 
produc’d If he cannot, he here runs in a circle, and giv es a s\ nonv mous term 
instead of a definition 

Shall we then rest contented wuth these two relations of contiguity and 
succession, as affording a complete idea of causation^ By no means An 
object may be contiguous and prior to another, without being consider’d as 
Its cause There is a NECESSARY CONNECTION to be taken into con- 
sideration, and that relation is of much greater importance, than anv of the 
other two above mention’d (p 379) 

But surely we have made an advance over Hume in that we have 
given up the “association of ideas” in favor of the more objective and 
operational emphasis upon behavior and behavior change Actually, as 
will be recalled from earlier chapters of this book, the natural course 
of Behaviorism has been such as eventually to force back upon us a 
recognition of something very much like the association of ideas (con- 
ditioning of images, Chapter 5), and Hume himself was by no means 
without an appreciation of what was to be gained by the objective 
approach Already in the Treatise of Human Nature there was a section 
entitled “Of Reason in Animals”, and in An Enquiry Concerning Un- 
derstanding (1777), there is the following more extended and explicit 
discussion 

Evrst^ It seems evident, that animals, as well as men, learn many things from 
experience, and infer, that the same events will always follow from the same 
causes By this principle they become acquainted with the more obvious 
properties of external objects, and gradually, from their birth, treasure up a 
knowledge of the nature of fire, water, earth, stones, heights, depths, etc , 
and of the effects which result from their operation The ignorance and in- 
experience of the young are here plainly distinguishable from the cunning 
and sagacity of the old, who have learned, by long observation, to avoid 
vohat hurt them^ and to pursue vohat gave ease or pleasure 

This IS still more evident from the effects of discipline and education on 
animals, who, by the proper application of rewards and punishments^ may 
be taught any course of action, and most contrary to their natural instmcts 
and properties Is it not experience, which renders a dog apprehensive of pain, 
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w hen \ ou menace him, or lift the whip to beat him^ Is it not even experience, 
which makes him answ er to his name, and infer, from such an arbitrary sound, 
that you mean him rather than any of his fellows ^ 

In all these cases, we may observe, that the animal infers some fact beyond 
'what immediately strikes his senses, and that this inference is altogether 
founded on past experience, while the creature expects from the present 
object the same consequences, which it has always found in its observation to 
result from similar objects (pp iio-iii, italics added) 

Here we see clearly Hume’s first mam objective, namely that of 
showing that knowledge is 7 iot mnate, that we acquire our “ideas” 
through experience, through learning, and that Hume does not mean 
his theory to apply to ideas alone, but as well to actions Here, in the 
latter instance, it is not merely continuity that counts but also rein- 
forcement, in both the decremental and incremental sense 

Having shown that “ideas” are not innate, Hume proceeds to argue 
that they are, in general, likewise derived not from reason, but from 
experience Here surely was the Manifesto of Empiricism, empiricism 
m a double sense Empiricism as induction^ rather than deduction, as 
the royal road to knowledge, and empiricism in the sense of opening up 
the possibility for studying “mental processes,” not subjectively and 
“logically,” but objectively, behaviorally The historical and logical 
importance of the work of Hume (and associated thinkers) can there- 
fore hardly be exaggerated His books can certainly be read by con- 
temporary students of the psychology of learning with respect and 
profit — though It IS somewhat deflating to see how httle advance, m 
certain ways, there has been over what a bright young man was able 
to say about these matters more than two centuries ago^ 


111. Learning and the ^Xausal Texture of the Environment" 

As already indicated, contemporary behavior theorists have given 
comparatively little attention to the relationship between causation 
and learmng But m 1935, Tolman & Brunswik published a paper en- 
titled “The Orgamsm and the Causal Texture of the Enviionment,” 
which was destined to alter this situation Here an inteiesting and im- 
portant issue was raised It was pointed out that most laboratory studies 
had, up to that time, involved the learmng of living orgamsms under 
“constant” conditions Thus, if a rat ran through a maze once and found 
food in the goal box, it was the experimenter’s (if not also the rat’s) ex- 
pectation that food should always be found there Tbs sort of constancy 
or regularity was assumed to be an inherent part of the scientific 
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method But Tolman & Brunswik very persuasively aigued that such 
uniformity of reward does not parallel the natuial environment of 
hving organisms, where success and satisfaction are exceedingly chanc;y 
matters As Brunswik (1955) later observed, “The environment to 
which the organism must adjust presents itself as semi-erratic and 
therefore all functional psychology is inherently probabilistic” (p 
193) Hence it would follow that if one wants to study learmng in a 
more realistic setting, one should provide rewards intermittently rather 
than continuously 

It IS true that, prior to 1935, considerable work had been done on the 
extinction of learned responses, under conditions of nonreward, fol- 
lowing acquisition with rewaid This, to be sure, was a kind of vana- 
bihty or inconsistency, but the reward was usually consistently given 
up to a point, beyond which it was, again consistently, withheld In the 
conditioning experiments carried out in Pavlov’s laboratory the strength 
of a conditioned salivary response would sometimes be tested, as train- 
ing proceeded, by withholding the reinforcing (unconditioned) stimu- 
lus now and then, thus providing, inadvertently, a small element of 
mtermittency in the acquisition schedule But no systematic research 
or theorizing emerged in this connection, and it was really the Tolman- 
Brunswik paper that raised the issue of “probabilistic learning” for the 
first time in fully explicit form 

This paper stimulated two important lines of subsequent research, 
but before we explore them, it will be useful to look at the “common 
sense” of this problem in a little greater detail 

It goes without saying that if life were not chancy, learning would 
be unnecessary If life were simple and if expenential sequences were 
stable and certain, then the solutions to all problems could be “wured 
in,” as reflexes and instincts Such an airangement actually exists in 
certain limited areas Because it is invariably useful to dimmish the in- 
tensity of the light striking the retina of the eye when the intensity 
exceeds a certain maximum, it is highly adaptive to have a mechamsm 
which “automatically,” 1 e , with mechamcal certainty, reacts to hght 
in such a way as to control and limit its intensity One cannot think 
readily, if at all, of any circumstance in which such a protective device 
would not be advantageous, and, convemently enough, we are nor- 
mally born equipped with just such an arrangement We call it the 
“pupillary reflex ” 

Or, lacking reflexive solutions to its problems, an organism, in an 
environment of the kind described, could have a mechanism for ex- 
tremely rapid learning (“insight,” in the sense m which some Gestalt 
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psychologists have used the term) Assuming conditions to be con- 
stant, invariant, OJie experience in a given situation would be as good 
as a hundred, as far as the “information” derived would be concerned, 
so learmng might as well be complete and absolute, in one trial Actu- 
ally, as we well know, learning is usually a more gradual process, ^ and 
the indications are that this progressive, rather than all-or-none, nature 
of learmng is not just stupidity on the part of orgamsms Instead, it 
appears that life is indeed chancy, that many events are “purely coin- 
cidental,” and that the truth, i e , genuine causal relationship, is a mat- 
ter of probability and can be estabhshed only on the basis of repetitive 
occurrences Therefore, it is presumably by design, rather than by 
default, that the nervous system of living orgamsms changes gradually 
rather than precipitously An orgamsm can, of course, learn too 
slovoly, in which event we speak of its possessor as being really 
“stupid ” But an orgamsm could, in theory at least, also be too smart 
for Its own good If it learned too rapidly, then it would be regarded 
as credulous, naive, superstitious Its difEculty, to borrow an old quip, 
would be that it knew so much that “ain’t so ” 

The best formulation of this problem known to the present writer 
IS one to be found in a paper entitled, “The Brain Analogy A Discus- 
sion,” by H E Coburn (1952), who, interestingly enough, is an en- 
gineer, rather than a psychologist This paper should be consulted in 
the original for its full import, but its relevance to the present discus- 
sion IS suggested by the following quotation, which is the opening para- 
graph of a section entitled “Optimum Learmng Rate ” 

It is probable that the interaction of various mutations and natural selec- 
tion has established a rate of conditioning which closely approximates the 
theoretical optimum While slow learning is obviously detrimental, extremely 
fast learning may likewise be mjurious when we recall that one or two 
sensory samples do not determme an answer but merely establish a hypothesis 
The brain has no voay of ^^knowing^’ which elements of the stimulus situation 
are significant It must accept and condition to all S [stimuli], automatically, 
and in accordance with probabihty The appearance of purpose is due solely 
to the fact that systematic S result in stable conditionmg (p 456) 

And, in conclusion, this author says 

The foregoing discussion must necessarily be considered heuristic, and, 
as always with science, provisional It seems reasonable to conclude, however, 

®Krechevsky (1932) has conjectured that in a trial-and-error situation, hving 
organisms make trial responses in the manner of “hypotheses,” holding that such 
a response, when it occurs, occurs, so as to say, “full strength,” and is then con- 
firmed or refuted, but not “strengthened” or “weakened” Guthrie’s conception 
of learning (Mowrer, i960, Chapter 8) is somewhat similar See also Hudson’s 
monograph on “One-Trial Learning in the Domestic Rat” (1950) 
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that the importance of evolution for beha\ior theory has been demonstrated 
The author would also like to belie\e that the nature of reinforcement, prob- 
ably the outstanding problem in psychological theory , has been clarified a 
little (p 459) 

In short, then, we can perhaps say that an organism, to have an op- 
timal capacity foi “adjustment” to its emironment, must be neither too 
“trusting” nor too “skeptical” (cf statistical eirors, type I and type II, 
as discussed by Wald, 1950, and others) Its confidence ought, ideally, 
(through learmng) to come to match “the causal texture of the en- 
vironment” Therefore the way to study learmng most realistically, 
Tolman & Brunswik held, is to have an experimental environment in 
which events, such as reward, nonreward, or pumshment are more ot 
less probable, rather than absolutely consistent and certain 

iV. Learning with the Probability of Reinforcement Less 
than Unity ^Probabilistic Learning'^ 

The theoretical considerations advanced by Tolman and Brunswik 
opened up two new lines of empirical inquiry Heretofore it had been 
assumed that if, in laboratory experimentation, a given response on 
the part of a subject (for example, the negotiation of a maze by a rat) 
produced, or “caused,” reward on one trial, it should always produce 
reward and that if a given signal (as in Pavlovian conditiomng) was 
followed by (“caused”) a given unconditioned stimulus (or reinforce- 
ment) on one trial, it should have the same effect on all trials At least 
these were the rules which were tacitly accepted for that portion of an 
experiment in which learning (acquisition) was supposed to occur, 
although they could be changed if one wished to study the course 
of extinction (Mowrer, i960. Chapter ii), but here again, if condi- 
tions were changed from reinforcement to nonreinforcement, the lat- 
ter was likewise supposed to be absolutely umform, consistent How- 
ever, as Tolman & Brunswik pointed out, these are not the conditions 
which ordinarily prevail in a state of nature, and living organisms must 
therefore be capable of learmng “the causal texture” of an environment, 
not only when cause-and-effect relationships are uniform and con- 
sistent, but also when they are irregular and inconsistent, 1 e , under 
conditions wherein reinforcement is not certain but merely more or 
less probable 

These theoretical considerations opened up two new lines of em- 
pirical inquiry, one of which has already been extensively reviewed 

^For an extreme development of this, or at least a related line of thought, see 
Estes (1950, 1955a, 1955b), also Mowrer, i960, pp 287-292 
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elsewhere (Mowrer, i960, Chapter 12) under the heading of ‘‘inter- 
mittent reinforcement,” and the other, commonly referred to as “proba- 
bilistic learning,” will be discussed in this and the following section 
Howevei, it should be noted that when first embarked upon, both of 
these lines of investigation led to paradoxical findings, which seemed 
to constitute serious threats to the whole reinforcement (reward-and- 
punishment) approach to learmng But now it has been show n that by 
means of the revisions in reinforcement theory which have been sys- 
tematized in Learmng Theory and Behavior (and summarized in the 
first chapter of this volume), the results of intermittent reinforcement 
can be accommodated very comfortably within this framework And 
we shall now see that although the work on probabilistic learning also 
presents certain seeming difficulties for revised two-factor learmng 
theory, these, too, can be mcely resolved by the same basic assump- 
tions and principles and that, in the process, we gam some important 
insights into the problem of probability and statistics in general 

In inteimittent reinforcement, it will be recalled, there is only one 
“correct” response and it is correct (effective) only part of the time 
But suppose, now, that an orgamsm is presented with a problem, e g , 
hunger, which can be solved by either of tvoo different responses and 
that the likelihood of reward for these two responses is not the same 
A simple T-maze provides such a situation, physically, and a reinforce- 
ment schedule of, let us say, 75% reinforcement for going to the goal 
box in the right wing of the maze and 25 % reinforcement for going to 
the goal box in the left wing of the maze provides the desired psycho- 
logical conditions 

A prion, the results are not difficult to predict In the beginning, the 
subjects (1 e , rats) might be expected to show an equal, or 50-50, 
tendency to turn right and to turn left at the choice point in the maze 
But right turning would be reinforced 75% of the time and left turmng 
only 25% of the time, so the right-going tendency ought to build up 
more rapidly than the left-going tendency, and eventually the subjects 
ought to go right 100% of the time This outcome would not only be 
expected from the fact of differential reinforcement, it would also be 
a “logical” solution to the problem since it would maximize reward As 
long as a subject went to the right on all trials, he would be assured of 
reward on three-fourths of these trials, and any departure from 100% 
preference for the right side would, on the average, cause the ratio of 
reinforcement to drop somewhat below three times in four However, 
m some experiments thus far reported, a seemingly different kind of 
result has, in fact, been obtained 
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It cannot be our purpose here to review all of the researches w hich 
have now been carried out along the lines just indicated Instead, we 
shall cite only enough of these to indicate what appears to be trends 
We shall begin with a study reported by Brunswik, in 19:59, which the 
author summaiized as follows 

As a contribution to w^hat might be called the “psychophysics of proba- 
bility,” five groups of 48 rats each were rew arded on the n\ o sides of a 
choice situation different proportions of times A training of 24 trials 
failed to establish a discriminatory response in only one of the groups, for 
which the chances of reward on the two sides were against (group 
“67 33”) In contrast to that, groups “100 50,” “75 25” and “50 0” w ere signifi- 
cantly above the “threshold of probability” m an increasmg order For the 
last of these groups, “50 o,” the difference with control group “100 o” which 
represented the traditional unambiguous t)pe of training dropped below 
significance (“threshold of certainty”) (pp 194-196) 


ORIGINAL TRAINING REVERSED TRAINING 

Generally unprofitable side Generally profitable side 



Generally profitable side Generally unprofitable side 

Fig 9-1 Graphic presentation of the results obtained by Brunswik in an experiment 
on “probability learning ” 


The results of the part of Brunswik’s experiment which is of major 
interest to us here are shown in Fig 9-1 It is to be noted, m the first 
place, that all groups of subjects began the experiment with an evenly 
divided (50—50) preference for the right and left wings of the T-maze 
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The group that was consistently rewarded in one wing and consistently 
not rewarded in the other wing (loo o) moved steadily, as the lower 
curve in the graph shows, toward a “one-sided” choice In contrast, the 
ratio of 67% reinforcement on one side and 33% reinforcement on 
the other was not readily discriminated by the subjects from a purely 
chance (50 50) pattern of reinforcement However, toward the end of 
the original training period (24 trials), there is some evidence that 
discrimination was begmmng to occur, and, in the reversal period that 
followed, there is rather clear evidence of discrimination As will be 
seen in Fig 9-1, the other ratios of reinforcement, falling between 
67 33 and 100 0, gave intermediate results 

Taken as they stand, these results seem to favor the notion that, in 
an experiment of the kind described, rats tend, in their choice between 
two alternative goals (which differ only in frequency of “pay-off”) 
to match the objective probabihties rather than to maximize the pos- 
sibility of reward (cf Heron, 1942) Such an interpretation might 
seem, at first glance, to support the notion that learmng is a special 
sort of cognitive process rather than one determined by reinforcement 
Certainly, the behavior of Brunswik’s rats seems to reflect more strongly 
the nature of reality than their own needs or self-interest (cf Wood- 
worth, 1958) 

There are, howevei, two considerations which warrant some reserva- 
tion in this connection In the first place, the imtial training was stopped 
after only 24 trials, at a point where all groups were still moving in 
the direction of greater preference for the “more profitable” side It is, 
of course, entirely possible that if the subjects had been given a more 
extended experience in this situation, they would have arrived at a 
“maximizing” rather than “matching” solution to the problem In 
other words, it is possible that all groups would have eventually de- 
veloped substantially a 100% preference for the moie profitable side 
and a 0% preference for the less profitable side Therefore, as far as 
this important theoretical question is concerned, these data are in- 
complete and inconclusive (see Brand, Woods, & Sakoda, 1956) 

Moreover, the procedure used in Brunswik’s investigation was such 
as to be, in one respect, decidedly unfavorable to the maximizing solu- 
tion Whenever an animal went to one or the other side of the maze 
and found no food there, it had to “correct” its errors by turmng 
around and going to the other side of the maze, where food (in most 
groups) would now be found This meant that on those compara- 
tively rare occasions when a rat found no food on the generally “more 
profitable” side, it would be required to leave this side and go to the 
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less profitable side This procedure insured contmued reinforcement 
on the less profitable side and worked against loo*^ selection of the 
more profitable side 

Hence, it is evident that for a clear-cut answer to these issues, a 
new experiment needs to be carried out which would be, in general, 
similar to Brunswik’s but different from it in that (i) a noncorrection 
rather than correction method would be used and that (2) the train- 
ing would be continued for a sufficient number of trials to show 
unequivocally what the subjects’ stable, final adjustment would be 
To the best of the present writer’s knowledge, no one has carried out 
an experiment of this sort, with ammal subjects ^ 

There has, however, been a considerable amount of research done 
on probabilistic learmng with human subjects w’hich w^e can now 
profitably examine Fortunately, this work has been admirably sum- 
marized in an article by Grant (1953), which we shall here follow® 
Says Grant 

The writer’s interest m this problem arose in connection with the problem 
of extinction m conditioning Extinction implies the discrimination of a 
change in the sequence of stimuli The problem becomes acute in the situation 
of partial remforcement where the subject is randomly reinforced on only 
25%, 50%, 75%, or some other percentage of the trials 

In the subsequent extinction the subject may require quite a large number 
of trials before a clear-cut discrimination of the change in stimulus conditions 
occurs The discrimmability of the change in stimuli during extinction 
has been the explicit or implicit basis of mterpretations of extinction pro- 
posed by several investigators (Grant, Hake, & Hornseth, 1951, Humphreys, 
1939b, Jenkins Stanley, 1950, Mowrer & Jones, 1945, Virginia Sheffield, 
1949, and Skinner, 1953a) (p 19) 

Grant then describes the apparatus with which several of his owm 
researches have been carried out It is similar to a device originally 
employed by Humphreys, consisting of a board with two electric lamps 
mounted on it, one at the left and the other at the right When the 
lamp at the left is illuminated, the subjects are then to gz/ess whether 
the lamp at the right will or will not also be turned on On successive 

® Since the above was written, an unpublished study by Stanley (1950) has been 
called to the writer’s attention which appears to meet these two conditions, of 
noncorrection and extended traming The results of this experiment ha\e not 
yet been seen, but indirect reports are to the effect that given these conditions, 
the subjects (rats) tended to maximize rather than match The same finding seems 
to have been obtained in the study by Bush & Mosteller (1951), which again, 
has not yet been examined in the original See also Estes (1959) 

Tor a different attack upon the problem, see Bruner, Goodman, & Austin 
(1956, Chapter 7) 
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trials, the signal light (at the left) can be “confiimed” (by hght at 
the right) on any desired percentage of the total number of the tnals, 
and the experimenter can see, from the subjects’ records, how well 
they approximated in their guessing the actual pattern of confirma- 
tion or “reinforcement ” In Fig 9-2 we see the results obtained from 
such a procedure 



Successive five-trial blocks 

Fig 9-2 Data reproduced from Grant, Hake & Homseth (1951) showing how 
closely the guessing of human subjects approximates the actual ratio of confirmed 
and nonconfirmed stimulus sequences 

At first It may appear that the procedure just described is not stiictly 
comparable to that employed by Brunswik with rats as subjects In 
the Brunswik procedure, the subjects had two alternative routes to 
reinforcement, each of which might be either right or wrong on any 
given trial In the Grant experiment, on the other hand, no such response 
alternative is seemingly present The procedure would appear rather 
more like that where there is a single correct response, with some 
trials rewarded and others not But, actually, in the Grant (Humphreys) 
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procedure, the subject does hate two altcrnames atailable to him on 
each trial he may guess either Yes or and he mat be right oi 
wrong eithej 'ivay He may guess that the signal light will be coi- 
firmed (followed by the other light) on a giten trial, and it ma\ or 
may not be, or he may guess that it will not be confirmed, and it mat 
or may not be ‘ Thus, as in the Brunswik T-maze procedure, a ''hif 
or a “miss” can occur in either case, w hich is 720 t true tt hen an animal 
in a conventional partial-reinforcement procedure, is lunning a straight 
alley or pressing a single Skinner bar In the latter tv^pe of situation 
there is 07 ily one possibility of success and one of failure 
There is, how’^ever, one thing that can be done with the T-maze 
procedure tvhich cannot be done w ith the flashing lights In the maze, 
one can have any desired ratio of reinforcement and nonreinforce- 
ment on either side, whereas, with the lights, there is necessarily a 
reciprocal relationship between the ratio of confirmation and non- 
confirmation of Yes guesses and No guesses But otherwise, the two 
procedures are comparable, and the fact that they lead to ostensibly 
different results, in rats and m human beings, poses a special problem, 
w hich wnll be considered in the next section 


V Probabilistic Learning in Rats and Men Compared 

In connection with the preceding analysis of the Brunswik experi- 
ment, It has been suggested that, given an opportunity, rats w ill tend 
to maximize reinforcement, whereas, in experiments of the type re- 
ported by Grant, there is a good deal of evidence that human beings, 
by contrast, stabilize at a level of guessing w^hich matches the ob- 
jective ratios, instead of maximizing the absolute number of “hits” 
For example, if the light on the left (in the Humphrey s-Grant ap- 
paratus) is confirmed, let us say, 75% of the time, then one could 

"Recent reports ha\e begun to appear in the literature on “probabilistic dis- 
crimination learning,” which Estes, Burke, Atkinson, and Frankmann (1957) de- 
scribe as follows “Consider a standard two-choice discrimination apparatus (eg, 
a Grice box or a Lashley stand) with two discrimination cues available, say a light 
and a tone To set up a classical discrimination problem, one might present either 
the light or the tone on each trial and reinforce responses to the right door w hen 
the light IS present To set up a probabilistic discrimination problem, one might 
assign to the tone and light the probabilities 8 and 4, respectiv el\ , of occurring 
on trials when the left response is reinforced and the probabilities 4 and 8, re- 
spectively, of occurring on trials when the right response is reinforces” (p 233) 
Here, too, a matching rather than maximizing solution is adopted by human 
subjects 
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be unfailingly right 75% of the time by guessing confirmation 100% 
of the time And every guess of nonconfirmation is likely to reduce 
this level of success because whenevei the subject pi edicts non- 
confirmation his chances of a hit are only one in four or 25% How- 
ever, human subjects, in their guessing, tend to approximate and stay 
remarkably near the objective ratio 
In Fig 9-2, the 75% and 25% cuives are still pointing in the direc- 
tion of a maximizing solution w^hen the experiment is ended, so, on 
the basis of these data alone, one might wonder if, given a sufficient 
number of additional trials, the subjects might not arrive, eventually, 
at the 100% and 0% levels of piediction But to this Grant says 

It might be mentioned parenthetically that in other experiments at Wis- 
consin and John Hopkins (Hake &. Hyman, 1953) it has been found that the 
75 and 25% assymptotes will be held for as long as 240 trials (pp 21-22) 
Increasing the proportion of positive responses when the proportion of 
positive trials is above 5 will increase the percentage of hits, but the subject 
must increase the proportion of positive responses to i 00 in order to maxi- 
mize the expected number of hits Instead of doing this he apparently stops 
increasing the rate of emission of positive responses when Pj. [response prob- 
abilit'v] is equal to Pg [stimulus probability] (p 24) 

It IS appal ent, then, that either we are not justified in inferring that 
rats, given favorable conditions, will maximize or else we must 
conclude that there are factois operative in human subjects m a situa- 
tion of this kind that are not to be found in rats 
In the paper which is here under discussion. Grant goes on to de- 
scribe the results of extensive experiments which were inspired by the 
Shannon-type of “information theory” However, these studies are 
extremely intricate and, for our purposes, not directly relevant Never- 
theless, Grant concludes his paper with some remarks which are 
easily grasped and well worth noting 

Inasmuch as the final stable solution does not maximize hits or reinforce- 
ments the question arises — ^what does it do^ Concentration of attention on 
single trials was shown above to reveal very little from the point of view 
of information analysis If, however, the stimulus rate is called “the response,” 
then an interesting relationship becomes clear (pp 40-41) 

In other words, the subject actually maximizes the transmission of infor- 
mation by his performance Rather than maximizing reinforcements on single 
trials, the subject regularizes his behavior so as to mmimize the stimulus- 
response variability Lest this findmg be taken to support contiguity theory 
one must recall that the result does not deal with single responses It is likely 
that a statistical contiguity theory such as that of Estes (1950) could handle 
the situation, but the older forms of contiguity and reinforcement theories 
must be doctored to cover this case Thus, the fact remains that what the 
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subject does do and what he does achieve is the ma\imi7anon of info mation 
transfer when the stimulus is defined as a rate and when the response is 
defined as a rate (p 42 ) 

Granted the essential soundness of Grant’s analysis of the behavior 
of human beings in a situation of this kind, it does not necessarily follow 
that rats function in the same way The goal of human subjects, in such 
a situation, may be quite different from those of rats For example, it 
IS entirely possible that, as Grant suggests, human subjects conceive 
their task, in situations of this kind, to be precisely that of matching 
their behavior to the stimulus probabilities Merely adopting the solu- 
tion that would maximize hits may seem entirely too simple and obvious 
to them Something else, they infer, is required of them But the rat, 
oblivious of any such considerations, would be expected, given the 
right conditions and enough trials, to maximize Support for this type 
of thinking comes from a study reported by VVyckoff Sidowski 
(1955) It begins thus 

The study of the reactions of human S^, when confronted with ambiguous 
situations, is of considerable theoretical and practical importance One aspect 
of this problem has been mv estigated in a number of experiments referred to 
as verbal conditioning experiments, which have utilized a paradigm origi- 
nated by Humphreys (1939b) and others (Grant, Hake & Hornseth, 1951, 
Jenkins and Stanley, 1950) In these experiments S was required to select one 
of two responses on each of a large number of trials Each response was 
considered “correct” by S a certain percentage of the time in a random 
sequence, and S was given some signal to indicate correct responses We w ill 
refer to the percentage of times that a given response was “correct” as the 
yield of that response 

All of these experiments have placed S in a situation where his assigned 
task has been to make a series of guesses or predictions The responses to be 
made were essentially verbal in nature, requiring no skill Recognition of 
this feature is illustrated by the use of the term “verbal conditioning” (Estes 
&, Straughn, 1954, Grant, Hake, Hornseth, 1951, Humphreys, 1939) Simi- 
larly the reinforcements have been simple cues which indicated that the re- 
sponse was correct or not correct These charactertistics appear to have 
set the stage for a kind of problems olviiig attitude on the part of S that is 
illustrated by the typical attempts of S to find a pattern in the sequence 
(p 225, Italics added) 

We shall make no attempt to describe or reproduce the results of 
the Wyckoff-Sidowski experiment, except to say that here there was 
a clear tendency for the subjects to maximize rather than to match 
Of this the authors say 

Reasons for the diiference between the present results and previous re- 
sults are considered in detail Our interpretation includes the notion that the 
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decreased tendenc\ to interpret the task as a guessing or problem-soh mg 
task eliminates certain factors which otherwise interfere with the approach 
to an optimal solution These factors are related to past experience wnth 
guessing and problem solving (p 231) 

Still remaining to be performed, it seems, is an experiment in which 
human subjects would be assigned, or would spontaneously assume, 
the task of getting as high a “yield” as possible Let us imagine, for 
example, a “slot-machine” which operated as follows Each trial or 
“play” costs, let us say, ten cents The player has a choice on each 
play of throwing a lever to the right or to the left The machine is 
rigged so that a left thrown “pays off” with twenty cents one time in 
four, while a right throw^ pays off by the same amount three times 
in four With this arrangement, the playei, if he chose the left throw 
consistently, would lose twenty cents every four trials (on the 
average), whereas, if he made the right throw consistently, he would 
(on the average) gam twenty cents every four trials And intermediate 
patterns of response would result in intermediate patterns of loss or 
gam 

Suppose, now, that such a machine were installed on a street corner 
or in a factory or club locker room Can there be any doubt what 
w^ould happen^ It would seem a foregone conclusion that players would 
soon start making all throws to the rights with resulting profit to them- 
selves and considerable loss to the owner of the machine ® 

Here is an apparent conflict m one situation (discussed by Grant) 
human subjects match rather than maximize, while in the other situa- 
tion we may confidently infer that they maximize rather than match 
Grant and Wyckoff & Sidowski have already provided a possible cue 
for the resolution of this difficulty, and the same line of thought is 
further extended in a paper by Edwards (1954) entitled, “The Theory 
of Decision Making ” The latter points out that the notion that human 
beings, in all their behavior, are endeavoring to “maximize something” 
is widely accepted by economists And to this he then adds 

Since the above was written a partial empirical confirmation has been reported 
by Edwards (1956) “Using real money rewards,” this investigator obtained re- 
sults which “raise doubts about the familiar generalization which says that m 
probability learning situations the asymptotic probability of choice is equal to 
the probability of reward” (p 177) In other words, this investigator, using human 
subjects, found a tendency to maximize reward rather than merely match prob- 
abilities See also a series of experiments recently carried out by Stevenson & 
Zigler (1958), Stevenson & Weir (1959), Stevenson & Weir (1960^), and Steven- 
son & Weir {igSob) 
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This notion of maximization is mathematicalh useful, since it makes it 
possible for a theory to specify a unique point or a unique subset of points 
among those available to the decider It seems to me ps\ chologicallv unob- 
jectionable So many different kinds of functions caji be maximized that al- 
most any point actually available in an experimental situation can be regarded 
as a maximum of some sort Assumptions about maximization only become 
specific, and therefore possibK urong, when the\ specify ^j.hat is being 
maximized (italics added, p 382) 

If, as in the example of the specially constructed slot machine, the 
motivation or “set” of the subject is purely economic, then “maxi- 
mizing” will lead to one sort of behavior But if, as suggested b\ 
Wyckoff & Sidowski and by Grant, the subject is trying to show 
someone else (or himself) that he can discern the ratio or pattern of 
confirmation and nonconfirmation in a given situation, then we can 
expect a different kind of performance But in neither case is the 
principle of “maximizing,” or reinforcement, violated In the one 
situation the subject is trying to maximize money and in the other he 
IS trying to maximize matching It all seems to be a matter of the sub- 
ject’s motivation ® 

VI Two Other Facets of the Probability Problem 

We may now usefully revert to two considerations relevant to 
studies of probability learning in ammals It has already been suggested 
that, in a favorably designed experiment, hungry rats may be expected 
to maximize the food obtained rather than to match, in their choice 
behavior, the objective probabilities of reward in one or the other of 

® The fact that both human and animal subjects, in food or money maximizing 
situations, develop a clear-cut preference for a response with high-remforcement 
probability over one with a low-reinforcement probability has important sys- 
tematic implicauons Such a preference would indicate, unequivocally, that a 
habit which is reinforced relauvely often is stronger than a habit which is rein- 
forced less often Yet we have seen that habit strength, as measured by resistance 
to extinction, is ostensibly greater when a habit has been built up by relam elv 
^frequent, rather than frequent, reinforcement This dilemma, together with 
other considerations previously advanced, suggests that we have probablv erred 
in assuming that resistance to extinction is necessarily a valid index of habit 
strength It now appears that, by the technique of intermittent reinforcement, 
what we do is not augment habit strength, properly speaking, but dnmmsh the 
effectiveness of extinction (in contrast to its effectiveness following continuous 
reinforcement) This conclusion is consistent with a point of vnew gradually 
evolved m Learning Theory and Behavior (see especially Chapters ii and 12) 
and in Chapter 5 of this book, see also jMason (1957) 
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two different places (as in a T-maze) In conversation, Dr Norman 
Gmsburg has made a quite pertinent observation in this connection In 
a situation where, let us say, the ratio of reinforcement for two dif- 
ferent responses is 75% 25%, it is a comparatively simple matter for a 
rat to discover that one response, or choice, is I?etter than the other, so 
that the rat will “favor,” 1 e , go predominantly to, one side rather than 
the other But it might be actually quite difficult, if not impossible, for 
the rat to discover that the maximizing solution (100% choice of the 
75% reinforcement alternative) would be “better” than the mere 
matching choice If, in this situation, a rat maximized, it would obtain 
food 6/8ths of the time, whereas if it matched^ it would do almost 
as well, receiving food 5/8ths of the time It is therefore possible that 
the rat w^ould simply fail to discriminate such a relatively small prob- 
ability difference Moreover, the rather mysterious tendency toward 
“spontaneous” response variability (Mowrer, i960, pp 336-342) might, 
quite independently, operate against a consistent, 100% selection of 
the 75% alternative (Indeed, one does not get absolutely consistent 
selection of even a 100 o alternative ) 

The other point to be noted in passing is this In this and the com- 
panion volume w^e are exploring the hypothesis that there are two kinds 
of reinforcement, decremental and incremental, and in the preceding 
discussion we have been concerned exclusively with the former So 
one may be prompted to ask What is the course of “probability” 
learning, where incremental rather than decremental reinforcement is 
involved^ As we know, nonoccurrence of an expected reward acts 
somewhat like a pumshment (Mowrer, i960, Chapters ii and 12) 
Therefore, in a situation ostensibly involving some specific ratio of 
reward and nonreward, we actually have a ratio of reward and “pumsh- 
ment ” But the further question remains as to how choice behavior m 
lower ammals would be affected if pumshment of a more active sort 
were introduced In the investigation already cited, Brunswik (1939) 
ran two additional groups of subjects in which reward and nonreward 
was supplemented by “an electric shock in each case of an unsuccess- 
ful choice” (p 183) The reinforcement ratios used were 75 25 and 
100 50 In both groups the rate of learning (to discriminate against 
an original equal preference for the two goals) was accelerated and 
the tendency toward maximizing, as opposed to matching, was clearly 
evident Says Brunswik 

^°Cf the inability of the rats in Brunswik’s 1939 experiment to “discrimmate” 
(withm 24 trials at least) between a 67 33 raao of reinforcement in a T-maze and 
a 50 50 ratio 
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Learning then increases w ith an increase of the probabiht\ ratio of punish- 
ment Apparently the avoidance of punishment becomes a stronger motn e as 
compared with the anxiousness of the animal to reach food as quickh as 
possible Discrimination of probabilities tends to increase with the 
increase of the ratio of the probability of einphasts on the u\ o sides of the 
probabilit\" discrimination problem (p 185) 

Being, along with Tolman, reluctant to take a reinforcement posi- 
tion, Brunswik interprets punishment, not as incremental reinforce- 
ment, but as providing “emphasis ” How ever, despite this interpreta- 
tion, there is nothing in Brunsw ik’s data that goes aganist a tw o-factor 
reinforcement interpretation It is true that incremental (negatue) 
reinforcement has, to date, been very little employed m studies on 
probability learning, although, as Edwards notes, the economic theory 
of maximization (or “reinforcement”) is cleaily two-sided Economic 
man is assumed “to seek pleasure and avoid pain,” in either an 
immediate or some future sense of those terms 

There are many other facets of the probability-learning problem that 
invite exploration, but enough has been said to show that there is no 
basic incompatability betw^een the empirical facts in this domain and 
our assumptions concerning the two-fold nature of remfoi cement and 
behavior change (or choice, cf Chapter 6) 


VIL Knowledge, Learning, and Reality 

In this section w^e shall be dealing with certain matters which are 
sometimes regaided as essentially “philosophical” and thus, perhaps, 
beyond the scope of scientific endeavor, but, as wx shall find, they 
are not without practical and, for our purposes, highly relevant im- 
plications Our thesis, specifically, will be that “knowledge” is a sort 

the writer’s instigation, Mr Mohammed Akhtar (1959b) has cairied out a 
study with laboratory rats in which it has been found that expectations generated 
by prior studies of intermittent reinforcement or, as we may now equivalently 
say, intermittent frustration are also met when one introduces acme punishment 
(electric shock) in place of or as a supplement to nonreward frustration These 
findings confirm our supposition that nonreward is itself a for 7 n of pumshment 
and that what happens in intermittent reinforcement is not that greater habit 
strength results but that the “sting” is taken out of nonreward frustration, as 
experienced during acquisition, so that it is less effective during extinction proper 
tLs is presumably why Mr Akhtar finds that active punishment (shock) is 
similarly less effective in inhibiting bar-pressing behavior during extinction if the 
punishment has frequently occurred and been followed by reward during ac- 
quisition (cf Tsushima, 1959) 
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of replica of the real world and that it is through learning that this 
“isomorphism” is established 

David Hume, writing in 1777, has already been quoted as saying 

It seems evident, that animals, as well as men, learn many things from 
experience, and infer, that the same exents will always follow from the same 
causes B\ this principle, thex become acquainted with the more obvious 
properties of external objects, and graduallx% from their birth, treasure up 
a knox\ ledge of the nature of fire, xx ater, earth, stones, heights, depths, etc , 
and of the effects w^hich result from their operation (p no) 

Here the key phrase is ti ensure up a kiw'wledge, of external objects 
and events This can only mean, suiely, that Hume saw learning as a 
process whereby lixang organisms, in physically confiontmg (ex- 
periencing) the real xxorld, leproduce xxithin themselves a sort of 
conception 01 picture theieof which they thereafter in some sense 
“carry around” xv ith them, 1 e , “treasure up” as knoxx ledge The same 
viexx has been expressed, m varying xvays, by many other writers but 
noxvheie better than by Vinacke (1952) in his book, Psychology 
of Thinking^ in a chapter with the graphic title, “The Internalization 
of Experience ” Here we read 

Various titles hax^e been suggested for the fact that the individual incorpo- 
rates in his ox\n system characteristics originally external to himself, such as 
symbolic representations of environmental objects, the norms of his culture, 
and the real or ideal traits of persons xvith whom he has close emotional ties 
We shall call this progresswe absorption process the “internalization of 
experience ” It has its basis both in the specific, recognizable learning 
processes which are studied extensively in the psychological laboratory and 
m more gradual, subtle learning processes, which, as yet, are comparativelx'^ 
little understood The effects of this latter kind of learning are becoming 
mcreasmfifly clear with intensive study of cultural differences, selective 
factors in perceptions and memory, and the evidence furnished by the 
clinic in the inner dynamics of personality (pp 262-263) 

Here one will think, immediately, of the process of imitation (Chap- 
ter 3) or “identification,” as it is sometimes called, wherein “habits” or 
“traits” of others are taken over, “incorporated,” quite literally and 
totally, by the subject But one xxill think also of a more rudimentary 
type of phenomenon Punishment and rewards are ordinarily con- 
ceived of as external events, things that happen to us But, as we have 
repeatedly seen in this and the companion volume, through learning 
living organisms “incorpoiate” both punishments and rewards, in a 
very useful and predictable xx^ay If a stimulus has preceded a punish- 
ment, that stimulus takes on the capacity to cause the organism to 
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pimish Itself^ i e , to afraid^ and if a stimulus has picccded a reward, 
that stimulus takes on the capaciu to cause the organism, likewise to 
reumrd itself, le, to be relle^ed, hopeful Hence it is a simple m<*ttcr 
to articulate Vmacke’s thesis with e\en the most rudimcntar\ form> 
of learning as we now understand them But its applicabilin is per- 
haps most strikingly e\ident when we examine the phenomenon of 
imagery^ \\ hich has forced itself upon our attention in this book A 
physical stiinuliis gets inside us fiist as a semation^ but the latter is 
normally coterminus with the stimulus itself and, at best, pro\ides the 
basis for what is called a perception, but it does not as such constitute 
memory or knovsledge As we have seen in Chapter 5, however, a 
sensation can be conditioned (in attenuated form) to other psvcho- 
logical events and may therefore be leactivated, as an image, in the 
absence of the original stimulus, thus providing the basis for what 
has traditionally been knowm as the “association of ideas ” Here w e see 
“internalization” in a particularly dramatic form vv hich, as indicated in 
Chapters 6 and 7, has fai -flung implications 

The import of these considerations for the present discussion i^, 
specifically, this that vve must assume that probability has, first of all, 
a basis in the real w orld w hich, by means of learning can be gradualh 
reproduced in the nervous system so as to give a <=ense of conviction, 
or set of expectations, which coi responds fairly precisely (one would 
hope) to prevailing external lealitv Thus, of necessitv% we assume 
an external reality (probabilitx ) and an internal (personalistic) one, 
and learning is the process whereby the latter comes to match the 
former This is the essence, it seems, of knowledge, wasdom, realism 
(cf Section IX, also Polanyi, 1958) 

Vin Causality and Human Behavior 

In Section II of the preceding chaptei Laplace and Poincare hav^e 
been represented as holding, with impeccable logic, that the universe 
IS consistently and inexorablv" deterministic, and our whole analysis 
of the concept of “chance” was predicated upon this assumption But 
this view now leads us to the familiar contradication existing between 
such strict determinism and man’s apparent or at least presumed 
freedom Does our specialized know ledge of the principles of learning 
provide any sort of resolution of this paradox^ 

In 1952 there appeared in the American Scmimt an article by Adolf 
Grunbaum entitled “Causality and the Science of Human Behavior” 
which admirably sets the problem just alluded to Here the author says 
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It IS not uncommon to find that even those who have complete confidence 
in the continued success of the scientific method when applied to mammate 
nature are highl) skeptical of its applicability to the study of human be- 
ha\ lor 

Se\ eral important arguments ha\ e been offered against the hypothesis that 
cause-effect relationships exist in human beha\ lor In this article I shall 
attempt to show that the arguments in question are invalid and that there 
arc good reasons for accepting the causal hypothesis against w hich they are 
directed 

If human behavior, both individual and social, does not exhibit cause- 
effect sequences, then the scientific method is essentially irrelevant to the 
elucidation of the nature of man, and both scientific psychology and the 
social sciences are permanently barred from achieving the status of sciences 
(P <565) 

Dilthey and his followers m the Getsteswtssejischaften movement insist 
on the methodological autonomy of psychology and the social sciences, 
claiming that intelligent goal-seeking, which is so characteristic of man, calls 
for a method differing toto genere from that of the physical sciences 
Rules for managing individuals and nations can be based only on causal laws 
w hich tell us that /f such and such is done, it is likelv that the outcome will 
be thus and so, either in all cases or in an explicitly stated percentage of 
cases It IS useless to bemoan the great gap between our mastery of physical 
nature and our scientific understandmg of man, if one denies the existence 
of the conditions which alone would make a scientific analysis of man pos- 
sible Only if human behavior does display some kind of causal law is it 
significant to emphasize the need for closing the dangerous gap between 
man’s control over physical nature and his scientific knowledge of himself 
lest he destroy himself (pp 665-666) 

The author of this article concedes that “the assumption that causal 
laws are discoverable” for human behavior involves some rather stag- 
gering difficulties, but the nature of his ultimate faith in this connec- 
tion IS already apparent However, in his attempt to implement this 
faith, he does not see the problem in the light which, from the stand- 
point of our present analysis, would seem to make it most manageable 
As our inquiries in this and the preceding book have shown, about 60 
years ago American psychology adopted a radically new program and 
philosophy which very mcely agreed with the premises of the physical 
sciences concerning cause and effect The basic formula was stimulus 
(cause) produces response (effect) All was strictly determined The 
individual had no spontaneity, no freedom, no self-determination, no 
choice, he was strictly a machine which reacted only when in some 
way stimulated But, as we have now seen, this approach encountered 
some very serious difficulties Apphcation of the if-this, then-that 
formula, as the basis for deriving scientific laws, was beset with the 
stubborn reality of behavioral variability This, it was found (and as 
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everyone knew already), produces that m some individuals, but some- 
thing else in others, and the attempt to build up trusn\orthy induc- 
tions concerning simple stimuh-iesponse correlations got nowheie 
Almost at once it was e\ident that the anahsis would have to be 
pitched at a highei level, namely, one that would take the source of 
this v^aiiabilit\ , namclv Icaiimig, into s\stematic account, and this is 
why the theoiies of Pavlov and Thorndike came so immediateh to the 
forefront in behavioi theorv’ Here were different, but equally plausi- 
ble, attempts to show that, for psychology at least, the this (inde- 
pendent v’aiiable) must not be conceived of simply as a stimulus but 
rather as the conditions under which behavior (the that, or dependent 
variable) changes For Pavlov the secret of “reinforcement” (be- 
havior change) was contiguity of stimuli (of a specified kind, in a 
specified sequence), whereas for Thorndike it w^as “effect,” in the 
sense of reward or punishment, and much effort, in this book and the 
companion volume, has gone into the comparison, elaboration, and 
integration of these two positions as they have developed ov^er the 
years 

First we had to discover the (surely ob\ious) fact that the behavior 
of most living organisms is by no means merely a matter of fixed 
reflexes If behavior is initially made up of reflexes, the latter aie 
modifiable either in the w ay suggested by Pavlov or m the w ay sug- 
gested by Thorndike or in both wmvs But then, as investigation pro- 
ceeded, It became apparent that reflexology simply would not do 
The linkage between stimulation and response is much looser, xve 
found, than the concept of the reflex allows Hopes and fears were, 
to be sure, reflexes and subject to modification in precisely the way 
Pavlov had postulated, but these reactions are emotions, not behavnor, 
and their “coupling” to behavior is by no means rigid and reflexive 
Most, if not all, life situations involve some element of conflict, and 
by means of operations considered in earlier chapteis, living oigamsms 
consider, compare, and integrate these competing inner forces into 
something called a decision (cf Chapter 8, Section VI) w^hich then and 
only then eventuates m action 

Moreover, as our analysis proceeded w e found that in order to hav e 
anything like an adequate conception of the decision-makmg or prob- 
lem-solving process, we had to take symbols and meanings into ac- 
count, and here we encountered the necessity for introducing into 
our system the concept of imagery or memory, to provide the cogni- 
tive counterpart to the affectivity already posited Thus there emerges 
a conceptual scheme in which “determinism” is not denied but elabo- 
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rated in such a manner as to grant to man and other higher organisms 
the measure of freedom and flexibility which they obviously possess 
The rigid and “stupid” determinism which early Behaviorism de- 
manded IS gone, and we now have a theoretical model which is at 
least beginning to approximate the realities as we intuitively know^ 
them Yet our labors have not simply brought us back to common 
sense and Faculty Psychologv^ In positing that man (and, to a lesser 
extent, other organisms), on the basis of values (emotions) and memo- 
ries of the past and images of the future, is capable of choice and 
more or less “rational” decision, we have not reverted to the doctrine 
of “free wnll” and //zdeterminism We have instead concluded that 
behavior is very complexly determined, first by the conditions that 
govern learmng (the principles of reinfoi cement) and then by sym- 
bolic operations in which learning, so to say, supplies the raw data 
but not the final solution Commonly w^e say that an individual learns 
to do this or that This is inaccurate The individual learns certain facts 
and certain emotions and then decides “w^hat to do ” 

This IS not to suppose for a moment that both learning and decision 
making do not obey laws which are just as much a part of the eternal 
scheme of things as are physical or chemical principles But it is to 
insist that within this framework the individual has or may achieve 
“freedom” in a very real and meaningful sense of the term 

A few years ago, in response to an article by Wilbur G Katz (1953) 
entitled “Freedom and Responsibility A Difficulty of Relating Chris- 
tiamty and Law,” the present writer published a paper entitled, “Free- 
dom and Responsibility A Psychological Analysis” (Mowrer, 1953) 
Here the foregoing argument was recapitulated and somewhat ex- 
panded as follows 

Up to this point our analysis has been strictly scientific and deterministic 
But It has proceeded along lines which promise to lead us to a clearer con- 
ception of “freedom and responsibility’’ as it applies no less in religion and 
law than m psychology and psychiatry In order to move forward in this 
regard, let us look first at what the word “freedom” does or does not imply 
It does not imply caprice or lawlessness Instead, in its most profound mean- 
ing, It implies the capacity to change, when circumstances change and old 
actions need to be replaced by new ones Inanimate objects, like stones, are 
the least free, most bound, fixed If you tap a rock with a hammer it may 
“change” m the sense of flakmg or crackmg but it will not change m the 
sense of becoming more or less resistant to our blows, much less will it 
change its “behavior” m the sense of “going away” or “fighting back” as op- 
posed to “staying put” passively and thus subject contmually to our assault 

To make the point at issue without undue elaboration, we may note that 
living organisms do a good deal better than stones and other inanimate 
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objects E\en the lowliest of creatures ha\e at least a small repertoire of 
variable responses they can make to noxious stimulation, and the higher ones 
can carry over their experiences fiom one situation to another In short, thev 
can Iear?2, and in so doing the\ achieve a still higher level of “freedom,” non- 
fixitv And man, by the use of language, attains to a loftier position still in 
that he can learn vicariously, thus av oiding in many instances ev en a single 
direct encounter with the situation to w hich the learning is relev ant 

It IS thus sufficiently clear that man, in his “right mind,” has the greatest 
freedom of all He is least determined, least doomed to stupid repetitiv eness, 
and most versatile, flexible, adaptive But man is no less lav\ful in his behavior 
than are other living organisms — or, for that matter, nonliving things, it is 
just that in him w e see the laves of learning most fullv and ingenioush de- 
veloped Behavior thus remains lawful but it makes the indiv idual “free” in the 
onh^ sense in which this term is meaningful, or “freedom” itself worth while 
or desirable^ (pp 67-68) 

Certainly an individual w^ho is functioning w ell and is “happy” feeh 
free and self-determinmg, regardless of what his philosophical pre- 
suppositions may be And, by the same token, we know that when 
the reverse situation prevails the individual feels helpless, trapped, 
hopeless, driven, doomed As one neurotic woman once said to the 
author, “I’m not sick, I’m just unfree ” So our concern is not with the 
question Is man, in some ultimate and enduring sense, free or under 
compulsion^ The fact is, man may be either, depending upon circum- 
stances The real question, therefore, is Why is man sometimes, in 
the experiential sense, free and sometimes not^ The answer is to be 
found. It seems, only if one vnews man as a social creature, and this 
will be a part of our purpose in Chapter 10 (see also Mowrer, 1959a) 

IX Two Conceptions of ''Probability" 

It may at first appear that, while bearing upon the relationship be- 
tween learmng and causation, the preceding discussion in this chapter 
is not particularly relevant to statistics and probability theory The 
relevance lies here Science is concerned wuth the discoverv^' of “truth,” 
particularly in the realm of cause and effect (as opposed to the more 
descriptive concerns of certain other disciplines, such as history) 
Cause and effect is apprehended, we now believe, by the familiar 
process of learning through contiguity (or perceived correlation) But 
the data from which such relationships are mferied (learned) may, 
as we saw in Chapter 8, be either clear-cut and unambiguous or more 
or less obscured by the operation of unintended and (very commonly) 
unidentified factors in the situation other than the one under specific 
examination (as the cause or independent variable) 
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Now if causal relationships are obvious and undebatable, we have 
no need for “statistics”, direct perception or “experience” sufHces But 
w^here data are equivocal, efforts have been made to invoke certain 
mathematical models as aids to our inferential efforts And here is 
where the trouble starts, both in theory and in practice As indicated 
m Chapter 8, serious practical difficulties arise in connection wath 
the use of such models, and besides, there is a general, theoretical issue 
which should now be considered In briefest form it can be stated 
thus Mathematical models are deductive, learning and scientific inquiry 
are, in general, inductive, therefore, the introduction of statistical 
methods (mathematical models), it is sometimes argued, is a toz^r de 
force and an impertinence 

For example, Jeffreys (1939) has put the matter this way 

The mathematical proof fused m statistics] is deductive, and induction 
in the scientific sense is simply unintelligible to the pure mathematician — as 
such, [although] in his unofficial capacity he may be able to do it very well 
Consequently little attention has been paid to the nature of induction, and 
apart from actual mathematical technique the relation between science and 
mathematics has done little to develop a connected account of the character- 
istic scientific mode of reasonmg Running through the whole is the 
tendencv to claim that scientific method can be reduced in some way to 
deducm e logic, which is the most fundamental fallacy of all it can be done 
only by rejecting its chief feature, mduction (p 2) 

In Chapter 8 (Section V) we have already seen how permeated the 
whole history of probability theory and statistics has been with dis- 
agreement and controversy, and a good deal of the difficulty has un- 
doubtedly arisen from the attempt to combine or “mix” the inductive 
methods of science (and ordinary observation) with the purely de- 
ductive rules of formal mathematics Whitehead once tried to resolve 
this difficulty by observing “There is a tradition of opposition between 
adherents of induction and of deduction In my view it would be just 
as sensible for the two ends of a worm to quarrel” (quoted from New- 
man, 1956, p 1341) And in Chapter 6 of this volume we have found 
a complementary and harmomous relationship between ordinary learn- 
ing (as induction) and reasomng or insight (as deduction) Certainly 
both are real and useful But as far as the theory and application of 
statistics are concerned, these two facets of the problem have only 
recently been clearly identified 

In an article on “The Meamng of Probability” which was published 
in 1935, Ernest Nagel made the following attack upon this problem 
On the premise that it is not “the philosopher’s task to legislate away 
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any of the meanings which ‘piobabiliu’ may ha\c, ’ he did, h(nve\ei, 
attempt “to distinguish betw een different m^eanings’ of this term ( p 
12) What IS for our purpose the heart of Nagel’s anaKsis of this 
problem reads as follows 

With these methodological principles in mind, I turn now to an anal\sis 
of the meaning of probability Lack of time, to sa\ nothing of lack of compe- 
tence, does not permit an adequate survey of the innumerable contexts in 
which propositions about probabilities occur I wish, however, to distinguish 
five broad type of contexts in which they do occur, consider three anah ses 
of the meaning of the term “probability,"’ and indicate the bearings of the 
abo\ e methodological considerations upon each 

Statements involving probabilities are to be found in (i) every -da\ dis- 
course, ( 2 ) in the field of applied statistics and measurements, ( 3 ) w ithin the 
context of phy^sical and biological theories, (4) m the comparison of theories 
with each other for their respective degrees of probability, and (5) m the 
branch of mathematics known as the calculus of probability Examples of 
each type of statement will appear in due course, in the discussion of the 
three major interpretations of probability^ with which I wish to concern 
myself To these I now turn 

The first interpretation is the classic one, associated with the historical 
development of the mathematical theory of probabilit\ It has been ex- 
pounded with vigor by the English logician and mathematician De Morgan 
According to him, the word “probable” refers to the state of mind with 
respect to an asseition for which complete certainty or knowledge does 
not exist Hence the degree of certainty of a proposition, its “probability 
IS the degree of belief with which it is held For certainty has degrees and 
all grades of “know ledge,” it is claimed, are capable of being quantitativ el\ 
conceived It is possible, therefore, to apply the calculus of probability to 
the degrees or strength of behef, if probability is defined algebraically as 
the ratio of the number of alternatives “favorable” to an “event” to the total 
number of equiprobable alternames The transition from this definition to 
the previous one is mediated by the principle of sufficient reason or indif- 
ference, according to which two propositions are equally^ probable if the 
strength of our belief is equally div ided betw een them 

The second interpretation of probability is professed by certain English 
logicians like the economist Ke\nes Accoiding to it, any two propositions 
are related not only by the relations usualh studied in traditional logic, such 
as implication, but also a directh mtuitable relation called probabilitv 
This relation is not analyzable, although it is capable of hav ing degrees How - 
e\ er, while any tw o propositions w ill each hav e some degree of probabilit\ 
wath respect to a third, the degrees of probabilitv are not in general com- 
parable or measurable Hence it is not aKva\ s possible to applv the calculus 
of probability in order to explore the implications of compound assertions 
of probability relations But w henever the calculus is applicable, the applica- 
tion is carried on in terms of a modified principle of indifference 

The third interpretation of probability is already implicit in Aristotle, but 
has become prominent only within the last century^ as a consequence of 
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apph ing the probability calculus to a statistics and ph) sics Its central idea 
IS that b\ the probability of a proposition or an “e\ent” is meant the relatue 
frequency of the “event” in an indefinite class of e\ents A more precise 
statement of this \ lew \\ ill be gi\ en presently It is sufficient at this point to 
emphasize the fact that on this interpretation every statement invoking 
probabilities is a material proposition whose truth or falsity is to be dis- 
covered by examining objective relative frequencies (pp 14-16) 

Now before we discuss the Nagel analysis, it will be useful to place 
along side of it another attempt, more recently made by Savage ( 1954), 
to provide a similar “taxonomy” of the meanings of the term, piob- 
ability This w riter says 

It is unanimously agreed that statistics depend somehow on probability 
But, as to what probability is and how it is connected with statistics, there 
has seldom been such complete disagreement and breakdown of communi- 
cation since the Towner of Babel (p 2) 

1 would distinguish three mam classes of views on the interpretation of 
probability, for purposes of this book, calling them objectivistic, personal- 
istic, and necessaiv^ 

Ob'jectivisttc views hold that some repetitive events, such as tosses of a 
penny, prove to be in reasonablv^ close agreement with the mathematical 
concept of independently repeated random events, all with the same prob- 
ability According to such views, evidence for the quality of agreement be- 
tween the behavior of the repeutive event and the mathematical concept, 
and for the magnitude of the probability that applies (in case any does), is to 
be obtained by observation of some repetitions of the event, and from no 
other source whatsoevei 

Feisonalistic views hold that probabilitv measures the confidence that a 
particular individual has in the truth of a particular proposition, for example, 
the proposition that it will ram tomorrow These views postulate that the 
individual concerned is in some ways “reasonable,” but they do not den\ 
the possibility that two reasonable individuals faced with the same evidence 
mav hav e different degrees of confidence in the truth of the same proposition 

Necessary views hold that probability measures the extent to which one 
set of propositions, out of logical necessity and apart from human opinion, 
confirms the truth of another They are generally regarded by their holders 
as extensions of logic, which tells when one set of propositions necessitates 
the truth of another 

After what has been said about the intensity and complexity of the contio- 
V ersy over the probabilitv’^ concept, you must realize that the short taxonomy 
above is bound to infuriate any expert on the foundations of probability, but 
I trust it mav do the less learned more good than harm (p 3) 

Upon reading either Nagel’s or Savage’s analysis alone, without the 
other, one might be somewhat uncertain as to precisely what is implied 
by the three definitions, or types, of probability which each of these 
writers lists But if one puts these discussions together, they usefully 
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complement each other and give us three relativeh clear-cut and dis- 
tinct conceptions Let us begin by looking at what Sa\age calls the 
obpctivistic view and Nagel’s “third interpretation of probability,” to 
which he gives no descriptive name but chai acterizes b\ sa\ing that 
“on this interpretation every statement imohing probabilities is a 7 m- 
tend proposition whose truth or falsity is to be discovered by examin- 
ing objective relame frequencies” (p 1404) It is exident that both 
wTiters are refeiring here to what might be called the true \alue of a 
probability, 1 e , the value that w^ould be obtained if our obser\ ations 
w^ere exhaustive If one had a tiamload of black and w hite marbles, all 
mixed together, the true ratio of black marbles to all marbles (if we 
counted them) might turn out to be 29/104 So the true, or objective, 
“probability” of one’s blindly selecting a black marble (assuming a 
homogeneous mixture) would be 29 in 104, or ig/ioj^ths 
But let us assume that it isn’t practical to make an exhaustw e count 
of the marbles in this population (or “universe”) as a means of deter- 
mining how many black and how' many w hite marbles there are but 
that we still want to get some idea of w^hat the ratio is Our procedure 
will be to take a sample, large or small, depending upon how^ accurate 
we wash our impression, or estimate, to be, and selectively count the 
marbles therein Suppose that w e decide to use a sample of 1,000 marbles 
and that 250 of them turn out to be black The assumption or belief 
which wall be most reasonable in this situation is that the ratio of black 
marbles to all marbles is 250/ 1,000 or ^4 This is the best guess or most 
informed “hypothesis” one can make on the basis of the available infor- 
mation This IS presumably what Nagel calls the classical view of prob- 
ability and w^hat Savage calls the personalistic one In this connection 
Nagel speaks of a “state of mind,” “certainty of a proposition,” “degree 
of belief,” “knowledge,” w^hereas Savage speaks of “degree of confi- 
dence in the truth of a proposition ” 

Thus w^e may say that the objectivistic definition of probability is 
based upon an exhaustive examination of the pertinent data, but such 
an examination is often impossible (or at least impractical) and so leaves 
this value as an unknown, an abstraction, an “ideal ” The personalistic 
definition, on the other hand, involves a belief concerning this abstrac- 
tion which has been established on the basis of evidence, or experience, 
w^hich is partial, fragmentary, nonexhaustive In situations where an ex- 
haustive examination of the facts has been made, the objective and the 
personalistic conceptions of probability coincide, but when the reverse 
is true, 1 e , when the examination has not been exhaustive (when w e 
have merely “sampled”), it is necessary to distinguish between the 
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“true” and the “obtained” ratio, accepting the latter as the best available 
estimate of the former 

An estimate of a probability is obviously psychological, m the sense 
that It represents ^vhat some one or more persons have learned and thus 
believe about some state of affairs, hence the term “personalistic ” In 
the ultimate analvsis, the true (“objective”) state of affairs is also psy- 
chological or “personalistic” in that it, too, involves knowledge which 
IS inside someone’s head But, bv its very nature, it is projected or per- 
ceived as being “out there” and so may appropriately be termed “objec- 
tivistic” (cf Polanyi, 1958) 

What, now, of the third conception of probability which our authors 
list^ Savage identifies this as the necessary view, which holds that “one 
set of propositions, out of logical necessity and apart from human opin- 
ion, confirms the truth of another”, and Nagel, who particularly associ- 
ates the name of John Maynard Keynes with this position, characterizes 
It by saying that “any two propositions are related not only by the 
relations usually studied in traditional logic, such as implication, but 
also by a directly intuitable relation called probability ” In bold relief, 
we can term this the logical or inferential conception of the probable, 
or probability Suppose that we know something about the origin or 
the intended use of the trainload of marbles Then we can make either 
very exact deductions or more or less plausible guesses about the ratio 
of black marbles to all marbles Such a conception of or way of arriving 
at a “probability” is obviously different from the two approaches first 
mentioned They are both empirical, the one exhaustively so, the other 
involving an estimate or approximation, whereas the so-called “neces- 
sary” view is logical, inferential, deductive 

Although we have made no direct attack m this volume upon the 
topic of logic or inference, we have approached it a number of times 
tangentially and can now suggest that it depends crucially upon the 
phenomenon of mediation (see especially the discussion of “reasoning” 
in Chapter 6) Inference is obviously very important, but although 
one can see why Nagel and Savage refer to the inferential (01 “neces- 
sary”) approach to probability, it is not what most statisticians and 
researchers have in mind when they speak or think about probability 
When a psychologist performs an experiment, he first reports his fold- 
mgSj quite objectively and accurately, and subjects them to whatever 
statistical treatment he thinks is appropriate, but he keeps all this sepa- 
rate from his conjectures and qualifications and interpretations which he 
may offer in that portion of his report which he very likely heads 
“Discussion ” Here, under the heading of “Discussion,” one lets himself 
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go a bit, somewhat disregards the constraints of statistical con\entions 
and plays out his “hunches,” talks “horse sense ” Here one is again dis- 
cussing what is “probable,” but probable in the sense of taking other 
considerations into account, not just the delimited experimental evi- 
dence (and Its “statistical” interpretation) This is presumably what 
Savage and Nagel have in mind in suggesting their third defimtion or 
conception of “probability ” 

Clarifying as the reader may find the foregoing threefold definition 
of “probability,” he wall nevertheless sense— if he has follow ed the dis- 
cussion here and in earlier parts of this chapter at all closely — an ambi- 
guity, a looseness, a disjunction Where, precisely, does it he? It lies in 
the policy pursued here, and in most discussions of probability theory, 
of selecting as an illustration a situation w^hich is static (something that 
ts, like the ratio of black marbles to all marbles in a given population) 
as opposed to a more dynamic situation, w herein one is concerned w ith 
the question of what causes what, of something not merely being but 
becoming And if we ponder this disnnction a moment longer, we see 
that there is a fundamental inconsistency between the notion of causa- 
tion and so-called probability Causation implies necessity m the rela- 
tionship between tw^o events, whereas probability, by its very nature, 
denies necessity and substitutes the notion of uncertainty, chance, pos- 
sibility 

It is true that our information or knowledge is very often incomplete 
or possibly unreliable and that we do well to qualify our statements, 
our “conclusions ” But when we thus say that this “probably causes” 
that, It can be very misleading It isn’t that the causation (or lawful 
relationship) is “probable ” Instead, it is our understanding of and con- 
trol over the situation that is “probable” and problematic, i e , permeated 
with Ignorance and possible error As we have seen earlier (Sections 
I-III of Chapter 8), the whole occasion for statistics arises from the 
confounding and multiplicity of “causes” operating in a situation, and, 
remarkably enough, statistics “work best” w^hen these extraneous causes 
are most numerous (so as to insure a near-normal distribution in the 
values of the dependent variable) When w^e know precisely what wx 
are doing and, as a result, have virtually perfect control of the situation, 
statistics simply are not necessary And this is whv B F Skinner, for 
example, has dedicated so much of his lesearch effort to the refinement 
of controls and the standardization of experimental conditions, rather 
than trying to “justify” (as he might say) slip-shod experimentation 
with elaborate statistical manipulations 

When the writer began work on this chapter and the preceding one. 
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his attitude toward statistics was considerably more positive and his 
respect greater than they now are Either we have deluded ourselves 
into thinking better of statistics than we ought, or else the present anal- 
ysis IS in some Avay seriously defective The w riter would welcome in- 
formed arguments in the direction of either of these possibilities 

This IS not to say, of course, that tests of significance and other com- 
monly employed statistical deyices are of no value whatever and should 
be discarded Even though one accepts all the reservations which have 
been advanced in the preceding discussion, one still tends to be grateful to 
the author of a research report for “using statistics,” in both their descrip- 
tive and inferential forms P-values, no less than graphs, are an aid to 
communication, and we are not here necessarily suggesting their aban- 
donment, at least not until “something better” is available But what 
can be emphasized, with considerable conviction, is that what we now 
have, in the way of inferential statistics, is not very good We should 
constantly remind ourselves that such techniques involve mathematic 
models which operate according to certain definitions and rules which 
apply only very approximately to most of the empirical situations to 
which w^e liken them In ordinary computation, our mathematical 
models work exceedingly well, yea, perfectly, but it is a serious error, 
It seems, to assume that all mathematical models have this same degree 
of pertinency and efficiency 

Or, let us consider an alternative way of viewing the situation Per- 
haps the fundamental difficulty lies, not in “statistics,” but in the fact 
that we ask them to perform an essentially impossible task As we have 
seen, despite some sophistry to the contrary, the basic objective in 
science is the ascertainment of causal relations, and perhaps there is no 
way to be sure of such relations in situations which are “noisy,” i e , 
situations in which there is a great deal of uncontrolled variance, or 
error Perhaps Skinner is right and that the only thoroughly satisfactory 
solution to the problem is to have “clear channels,” i e , to exclude more 
effectively than we commonly do the operation of extraneous variables, 
so that the effect of the experimental variable can “come through” so 
clearly that we do not need “statistics ” This is a perception which the 
author did not have a few months ago He will be interested to learn 
how generally shared his misgivings are — or, if they are ill-founded, 
how they can be corrected 




Social Learning 
and Human Personality 


Typically, the experiments already reported m this book ha\e in- 
volved an organism in either classical conditioning or in an attempt, on 
the part of the orgamsm, to solve a “physical” problem of some sort 
Here the opportumties for the experimenter to control the situation 
and to obtain clear-cut results are relatively good, and it is understand- 
able that much of the research on learmng has been of this general 
nature It goes without saying, however, that social learmng is also 
of very great importance — of supreme importance at the human level 
— and that our scientific as well as practical concern must be ex- 
tended in this direction Occasionally, in preceding chapters, we have 
alluded to situations involving the interaction of two or more subjects 
(see, for example, the discussion of imitation in Chapter 3), but this 
emphasis has been decidedly incidental Noa\ , at length, \\ e turn to a 
more direct consideration of the problem 
We shall start with both laboratory and field observations on social 
learning in ammals and then examine some of the special social demands 
and advantages which human beings experience Here, against the 
background of the earlier systematic discussions, we shall also briefly 
consider human personality and psychopathology But a word of 
caution Many earlier attempts have been made to “apply” learning 
theory to education, delinquency, neurosis, psychotherapy, and the like, 
with only limited success In this book v. e have seen how transient and 
continually evolving our conceptions of learmng have been While it 
is hoped that the psychology of learmng is at last coming of age, past 
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experience suggests caution and tentativeness in this connection Our 
primary task is still that of adequate conceptualization 

I Representative Experiments on Social Learning in Animals 

A number of expeiiments on the ‘‘social conditioning” pioduced in 
hunger-motivated rats, undei a variety of situations, have been earned 
out by students working with the present writei Severe competition 
and fighting, it was found (Adowrei, Kornreich, & Yoffe, 1940), produce 
w^ell defined and quite stable “dominance hierarchies ” If three hungry 
litter-mate rats are put into a small transparent plastic cylinder and 
given a single pellet of food, they will, for a time, be equally energetic, 
confident, and aggressive in competing for it (Fig lo-ia) However, as 
the experiment proceeds, the rats will experience unequal degrees of 
reward and punishment, with the result that one rat will emerge as 
clearly “dominant,” one as thoroughly subordinated, and one some- 
what intermediate in the “pecking order” (Fig lo-ib) ^ So effective 
may be the punishment inflicted by one rat upon the other during 
the competitive struggles and fights that the defeated one may become 
afraid to eat food m the experimental situation even though alone and 
extremely hungry (Fig io~ic) (cf Fredericson, 1951, Kohn, 1951, and 
Pavlov & Scott, 1956) The investigators cited — ^Mowrer, Kornreich, 
& Yoffe — originally planned to see to what extent this type of inhibi- 
tion and incapacity would generalize to other problem-solving situa- 
tions, but the contemplated experiments were never carried out (For a 
somewhat similar study, with mice, see Scott & Marston, 1953, also Scott, 
1958c, Grant & Chance, 1958, and Miller & Murphy, 1956a ) 

On the other hand, rats which have been reared from birth in a 
situation where they have to eat from a single pellet find that they can 
eat more rapidly and more continually if they stop tugging on and 
trying to escape with the common piece of food (Mowrer, 1938b) 
Provided they are not too seriously depiived, rats under these con- 
ditions, learn to “share” (Fig lo-id) (cf Fredericson, Fink, & Parker, 

1955) 

There is a temptation to speak, in connection with the last-described 
experiment, of “co-operation ” But this would probably involve a too 
general, too loose use of the term The word can more justifiably be 
applied to an experiment carried out by Crawford (1937, ^940 
admirably summarized by Nissen (1951) 

^This term comes from Schjelderup-Ebbe’s (1922) study of the dominance 
hierarchy that spontaneously emerges in domestic chicken hens 
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In a laboratory experiment, Craw ford first trained \ oung chimpanzees 
individually to pull in a weighted box, by means of an attached rope, m 
order to obtain the food reward on the box Then the weight of the box 
was increased (so that one animal could not move it) Next, two ropes 
were attached, the box was baited with two portions of reward, and two 



Fig 10-1 Enlargements from a motion picture (Mowrer, Kornreich, & Joffe, 1940) 
showing various stages of competition and cooperation in rats Fig la (upper left) 
shows three hungry rats so busy fighting over food that the food itself lies un- 
noticed in the right foreground In Fig ib (upper right) the same three rats are 
shown after their fighting (during the course of two or three half-hour sessions) 
has established one rat as dominant (at the left with food in mouth) and has in- 
umidated the other two Of the latter, the more subordinated, or “submissive,” 
animal is shown in Fig ic (lower left) Note that the social pumshment received 
for trying to eat in the competime situation has been so severe, and effective, that 
although now entirely alone (and safe), this animal is still inhibited Although 
quite hungry, this rat does not dare touch the pellet of food lying directly m 
front of him In this group of rats the problem of competiuon and fighting over 
food has been “solved” (after a fashion) by the estabhshment of a dominance- 
submission hierarchy A very different type of solution, mvolvmg sharmg, is shown, 
with a different set of rats, in Fig id (lower right) These rats, as a result of long 
experience (beginning at an early age), have found that by sharing each rat gets 
all the food it wants— and doesn’t have to fight The markedly different “social 
structure” m the two groups is mamfestly a result of leammg 
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animals were put in the cage At first each chimpanzee pulled without any 
reference to his partner’s actions, only by chance did the two pull at the 
same time and so mo\e the box It was necessary for the experimenter to 
gi\e a signal, which the partners had individually associated with initiating 
the pull, to get them to pull together Once the temporal coordination of 
effort had been established in this wav, the extraneous signal could be 
omitted One of the partners, A, usually watched the other, B, and was 
ready to add her pull as soon as B started heaving the rope Sometimes it 
w^as arranged that B was satiated when the experiment began, A would 
then urge and direct B to pull Eventually B would pull, although she had 
no desire for the food reward In these circumstances A often reaped the 
entire material benefits of the teamwork 

In a later experiment by Crawford one animal was trained to push against 
four colored plaques, arranged around the sides of a cage, in a certain order 
The cage was then divided into two sections by a partition of bars, the 
colors to be pushed first and third were on one side, the colors to be pushed 
second and fourth were m the other part of the cage The trained animal 
was then put on one side, and her partner, who knew the mechanics of 
pushing the plaques but not the correct order, was put on the other side 
of the partition The trained animal X watched her partner’s actions and 
pushed the color available to her after Y had pushed the color preceding it 
in the sequence, X sometimes solicited her partner, using begging gestures 
that were spatially directed toward the particular color on her partner’s 
side that was the next one m order (p 540) ^ 

Another type of social problem solving has been studied by the 
present author (Mowrer, 1939b) as part of the series of investigations 
already referred to Individually, hungry rats were placed in a box 24 
inches long, 18 inches wide, and 18 inches high It was open at the 
top, and the floor consisted of hardware cloth At one end of the box 
was a “Skinner bar,” located at a convenient height for operation by a 
rat, and at the othei ejid was a food trough into which a small pellet of 
food would roll each time the bar was pressed This arrangement meant 
that in order to obtain food, the hungry rat had to shuttle between bar 
and food trough, pushing the bar, going for the food, returning to push 
the bar, etc After this type of performance was well established in each 
of three rats, they were put into the apparatus simultaneously, thus 
creating an acute “social problem ” 

The difficulty was, of course, that whenever a given rat went to 
push the bar, one or perhaps both of the other rats, being nearer the 
food trough when the food-dehvery mechanism was activated, would 
get to the trough first and appropriate the pellet As a result, the bar- 

"For an annotated bibliography on the literature on competition and coopera- 
tion up to 1937, see Allport, Murphy, & May 
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pressing activity went unrewarded and tended to extinguish, while 
remaining near the trough and waiting for some othei luckless fellow 
to push the bar w^as reinforced Needless to sa\ , the production of 
pellets during the first session of one hour during w hich the rats w ere 
together was very low (Fig io-2a and lo-ib) 



Fig TO-2 Scenes from a movie entitled “An Artificially Produced Social Problem 
in Rats” (Mowrer, 1939b) By pushing a bar at one end of a box, a rat (Fig 2a, 
upper left) can cause a pellet of food to be delivered in a little trough on the 
opposite side of the box Now when three animals which ha\e learned, indiv idualH , 
to “make a living” in this w^ay are put together, the “social problem” shown in 
Fig 2b (upper right) arises the rat that does the “work” no longer gets the 
reward Finally, after much confusion and frustration, one of the three animals 
(in this particular group it happened to be No 3) gets so desperate (mad’) that 
It “attacks” the bar, biting and shaking it as shown in Fig 2c (lower left) The 
result IS that in this way one animal produces so mzny pellets that some are still 
uneaten by the other two rats when he gets back to the food trough A “class 
society” thus emerges a “worker” and two “parasites” These developments are 
shown graphically in Fig 10-3 


However, between this first session together and the second one, 
at the same time next day, the rats w ere given no supplementary food 
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In other words, a smk-or-swim policy was adopted with respect to 
their learning to “support” themselves in the experimental situation 
Usually, on the third day, one of the rats in a group of this kind 
would solve the problem Being now extremely hungry and also frzis- 
trated, one of the rats v ould have a tendency to seize the bar with its 
teeth, gnaw on it, rattle it, and thus cause it to move up and down a 
great many times in rapid succession (Fig io-2c) If the rat was then 



Fig 10-3 “Production curves” for the three rats depicted in Fig 10-2 On the 
first day, in this social-problem situation, all three rats, having previously been 
trained, alone, to obtain food m this apparatus, do a certain amount of bar pressmg 
but far too httle (during the one-hour test period) to sustain them, because the 
animal that presses the bar does not get the pellet thus produced Again on the 
second day, production remains low On the third day, with all three rats now 
extremely hungry, the soluuon begins to emerge By the fourth day, rat No 3, 
by the techmque shown in Fig 10-2, is “supporting” the entire group Because 
they were so hungry, it took over 1,100 pellets to satisfy the group on this day, 
but thereafter only about 600 (200 per animal) were reqmred Note that as 
rat No 3 became increasingly proficient as the worker, the other two rats pro- 
gressively abandoned their producme efforts Here, once more, we see the emer- 
gence of a social structure, or “system,” as a result of social interaction and learning 
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quick about it, he could get back to the food trough before the suppU 
of pellets thus produced had been consumed by the two idlers (Fisj 
lo-zd) Finding food after such a performance tended, of course, to 
cause a rat to repeat it, and when the multiple pressing of the bar 
became habitual, the problem w^as solved The t\ pical pattern of pellet 
production for a group of three rats under the conditions just de- 
scribed IS shown in Fig 10-3 Of several sets of rats run in this experi- 
ment, in only one did a ‘Svorker” fail to emerge, here the experiment 
had to be discontinued in order to prevent all three animals from 
starving 

An experimental attack upon another type of social interaction m 
rats was reported by Davitz & Mason in 1955 Bv way of introduction 
they say 

The purpose of this study was to investigate the effect of one animal’s 
presence on the strength of a fear response exhibited by another animal 
A study by Masserman (1943) suggested that a cat’s fear of eating was re- 
duced by observing a nonfearful cat eating, and a recent experiment by 
Liddell (1950a) demonstrated that presence of a mother goat increased the 
tolerance of kids to withstand environmental stress Therefore, generalizing 
from the results of these previous studies, we predicted that presence of one 
rat would tend to reduce the strength of a fear response exhibited by an- 
other rat 

The experimental population of the present study was divided into 
“Fearful” and “Nonfearful” Ss, and the experiment was designed to com- 
pare the strength of a fear response exhibited by Fearful Ss tested individu- 
ally, Fearful Ss tested with another Fearful ammal, and Fearful Ss tested 
with a Nonfearful animal (p 149) 

Davitz & Mason summarize their study thus 

The purpose of this study was to investigate the effect of one rat’s 
presence on the strength of a fear response exhibited by another rat The 
Ss were 48 male albino rats After 30 trials on which blmking light and 
electric shock were paired, the degree of fear associated with the blinkmg 
light and the apparatus was tested using an activity measure as the behavioral 
index of fear Fearful Ss were tested individually, Fearful Ss were tested 
with another fearful rat, Fearful Ss were tested with a Nonfearful rat, Non- 
fearful Ss were tested with a fearful rat, Nonfearful Ss were tested with 
another Nonfearful rat, Nonfearful Ss were tested individually The results 
[Fig 10-4] indicate that the presence of a Nonfearful rat reduced the 
strength of a fear response exhibited by a Fearful S and that the presence 
of another Fearful rat influenced behavior m the same direction but to a 
degree just short of significance These results were interpreted in terms 
of two opposing drive states curiosity and fear (p 15 1) 

Liddell’s finding that a kid is less likely to become panicky if the 
mother goat is present fits well with learning principles If the mothei 
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has acquired secondary-reinforcing (fear-reducing) properties for the 
kid, a stimulus which would otherwise arouse strong fear would be 
expected to arouse significantly less fear with the mother present And 
the same is true for Masserman’s observations If certain of the sounds 
and possibly sights associated with a cat’s own eating have taken on 
secondary reinforcement (see Mowrer, i960, Chapter 4), we would ex- 
pect similar sounds and sights provided by the eating of another cat to 
have much the same influence, and if, as assumed, secondary reinforce- 
ment consists of fear reduction, the effect noted by Masserman would 
follow as a matter of course (cf Stone’s 1954 review of presence and 
absence of human ‘"mothering”) 


Fig 10-4 Bar diagram showing 
the difference in exploratory be- 
havior of fearful rats tested 
alone (Fo) and fearful rats 
tested viith a nonfearful rat 
(Fnf) The purpose of the other 
groups represented in the dia- 
gram is explained in the text 
Reproduced from Davitz and 
Mason (1955, p 150) 


Fo Ff Fnf NFo NFf NFnf 
Group 

What the explanation of the findings reported by Davitz and Mason 
is cannot be so readily determined It may be that the mere sight and 
proximity of members of their own species is likewise reassuring and 
comforting to rats, but the authors point to other possibilities They 
say 

Although there is limited experimental evidence on the social factors 
which might influence fear and activity of rats, it does not seem unreason- 
able to hypothesize that the differences m activity observed in the present 
study were a function of two opposing drive states One of the drive states, 
curiosity, leads to active exploration of the test apparatus and the partner 
rat, the other, fear, leads to inactivity and freezing In terms of our response 
measure, these two drives are mcompatible, and factors which produce a 
change in either drive state would tend to influence the activity measure 
For example, the introduction of another animal or of a distracting stimulus 
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would increase the number of new stimulus elements to be explored, this 
might serve to implement the curiosiu drive and lead to increased acmitv 
On the other hand, the introduction of another animal might also ser\ e to 
make the testing situation less similar to the training situation [in w hich onl\ 
0726 rat was present at a time], thus, the fear of Ss tested with another rat 
mav have been less than the fear of Ss tested indiv idualh as a result of 
dilferential generalization (from traming to testing situation) of the 
secondary drive stimuli and mediating cues which elicited fear It is also 
possible that the curiosity and fear interact in such a way that introduction 
of another rat would increase the number of new stimuli in the test situa- 
tion, distract the attention of the fearful S from the fear-producing and 
f ear-mediating cues (le, blinking light and crouching), and thus lead to a 
reduction of the fear response (p 15 1) 

Although the inference that another member of the same species 
can provide secondary reinforcing cues and thus counteract the effect 
of fear cues is not unreasonable in the case of either the Masseiman 
or Liddell experiment, or even the Davitz-AIason experiment, the 
alternative interpretations suggested by the latter still need to be kept 
in mind and perhaps used as the basis of subsequent inquiry (cf Holder, 
1958) 

For many years it has been known that gentle, docile laboratory rats 
usually do better in an experiment than do wild, apprehensive ones 
A paper published by John B Watson in 1916 has alreadv^ been cited 
(Mowrer, i960, Chapter 10) in which the author says “Two groups 
of animals (rats), closely similar in age, docility, body weight, etc, 
were chosen” (italics added, p 77) And in recent years, many experi- 
menters have made a regular practice of “gentling” animal subjects 
before starting any kind of laboratory w ork with them 

A number of related studies, carried out in the Psychology Labora- 
tory at McGill Umversity, show that “intelligence” in an animal is a 
function of the variety of his social and environmental experience gen- 
erally Summarizing this work, Hebb & Thompson (1954) say 

Experimental studies have shown clearly that when the postnatal en- 
vironment is held constant the level of learning capacity and problem 
solving in the rat is innately determmed (Heron, 1935, Try on, 1940, Thomp- 
son and Bindra, 1952), that is, one can breed rats that will be brighter, or 
duller, when brought up in the same environment But they show equalK 
clearly that when heredity is held constant between experimental groups, 
by the split-litter method, infant experience determines the level of adult 
problem solving (Hymovitch, 1952, Bingham and Griffiths, 1952, Forgays 
and Forgays, 1952) The rat brought up in a “free environment,” or even 
with almost no freedom of bodily movement but with wide and extensive 
perceptual experience, is the better problem solver at maturity For the rat, 
then, adult mtelligence depends both on heredity and on the stimulating 
action of the postnatal environment (p 533) 



368 LEARNING THEORY AND THE SYMBOLIC PROCESSES 

V^arious other experiments, similar to those cited in the foregoing 
pages, could be described here, but the ones mentioned are representa- 
tive and will serve to indicate both the limitations and value of experi- 
mental work on social learmng in ammals The results are often in- 
teresting, but their scientific worth is sometimes questioned Many 
w^ords have been spent in debating the human relevance or “transfer- 
abihty” of such findings, and one of the most trenchant, yet conserva- 
tive, appraisals of the problem is that made by Hebb & Thompson, in 
these w’ords 

Thus the first point we make in citing this work is that animal experiment 
may clarify a human problem without “proving” anything It may draw 
attention to facets of human behavior one has not noticed, it may point 
to a troublemaking but implicit assumption, it may suggest a new principle 
of human behavior Furthermore, animal experiment in the past has re- 
peatedly shown that the treatment of some human problem or other has 
been oversimplified But m all these cases, the relevance of the animal work 
is strictly dependent on whether, when applied to man, it does clarify the 
human problem (p 533) 

Granted that experiments involving two or more ammal subjects are 
likely to be both intuitively interesting and also suggestive, the fact 
remains that the results thus far obtained do not “add up” very im- 
pressively, 1 e , have not given rise to any generally accepted theoretical 
system This fact has been cogently pointed out and a suggestion made 
for further progress in a paper by Sears (1951) Heie we read 

In the mam, in spite of their long prepossession with social influences 
on the mdividual, psychologists thmk monadically That is, they choose 
the behavior of one person [or animal] as their scientific subject matter 
For them, the universe is composed of individuals These individuals are 
acted upon by external events, to be sure, and m turn the external world is 
modified by the mdividuals’ behaviors But the universal laws sought by 
the psychologist almost always related to a single body They are monadic 
laws, and they are stated with reference to a monadic umt of behavior (pp 
478-479) 

But if personality and social behavior are to be mcluded m a smgle theory, 
the basic monadic unit of behavior must be expandable mto a diadic one 
A diadic unit is one that describes the combined actions of two or more 
persons (Although the prefix means “two,” the term is used here simply as 
the mmimal mstance of muluplicity Similar prmciples would hold whether 
the interactions were two or more ) A diadic unit is essential if there is to 
be any conceptualization of the relationships between people, as in the 
parent-child, teacher-pupil, husband-wife, or leader-follower instances To 
have a science of mteractive events, one must have variables and units of 
action that refer to such events While it is possible to systematize some 
observations about individuals by using monadic units, the fact is that a 
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large proportion of the properties of a person that compose his personalit\ 
are originally formed in diadic situations and are measurable onh by refer- 
ence to diadic situations or symbolic representations of them Thus, e\en 
a monadic description of a person’s action makes use of diadic \ ariables in 
the form of social stimuli (p 479) ^ 

There could hardly be a clearer, more concise statement of the 
existing status of behavioral science or a more persuasive call for the 
extension of systematic theory and experimentation from the isolated 
subject to the subject-m-relationship How ever, as of this writing, there 
is nothing to be reported in the way of achievement along these lines 
at all comparable to what has been and is still being accomplished b\ 
way of developing ‘"monadic” beha\ior theory Rotter’s recent (1954) 
book, Social Learning and Clinical Psychology , lists a set of “basic postu- 
lates for a social learning theory of personalit\%” but the contmuitv 
between these postulates and the principles w hich have emerged from 
ammal research is, perhaps of necessity, tenuous Says Rotter 

We refer to this point of view as a social learning theory of personality 
This approach as now developed makes only limited use of many specific 
“laws” of learning developed on subhuman species It seeks to use onlv^ 
psychological constructs in prediction without recourse to physiological 
concepts It is a social learning theory because it stresses the fact that the 
major or basic modes of behaving are learned m social situations and are 
inextricably fused with needs requiring for their satisfaction the mediation 
of other persons (p 84) 

It appears that a good deal more research and theory construction 
will be needed before the kind of material presented in the present 
volume can rigorously articulate wath the level of analysis represented 
by Rotter’s woik (cf Hare, Borgatta, S. Bales, 1955, Scott, 1950, 1956, 
Sidowski, Wyckoff, & Tabory, 1956, Sidowski, 19^7, \hnacke, 1954) 

II Unlearned Social Behavior in Animals 

As the preceding section indicates — and as we abundantly know 
from common observation, animal behavior is manifestly modifiable 
under the impact of experience with other organisms Also we know 
that social situations arise naturally in lower animals or can be experi- 
mentally created which afford suggestive parallels to humanly relevant 
problems of a social, economic, and political nature And, as we shall 
later see in this chapter, the end is not yet as far as fruitful research 

®For a good summary of social behavior and social organization in animals, 
see Chapter 8 of Scott’s (1958) book, Ammal Behavior Here one finds one type 
of attempt to systemauze social behavior 
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along these lines is concerned However, it is well at this point to remind 
ourselves of a major, and quite remarkable, limitation Social behavior 
in some mfrahuman organisms, in its most intricate and exquisite forms, 
js not learned but is dependent upon mechanisms which have been 
variously named but which all involve a large factor of innateness 

This fact constitutes both a severe limitation and a marvelous ad- 
vantage It gives to some ammal societies and to individual existence 
therein a static quality, a fixity, a rigidity, a predetermination which 
we human beings disdain and abhor, but it also constitutes a sort of 
guarantee of social and biological adequacy, born of thousands, even 
millions of years of evolutionary trial-and-error, which we human 
beings have lost We depend almost exclusively upon culture, w^hich 
is a learned phenomenon, both historically and individually speaking, 
and w^hile culture, as a way of life and guide to action, has certain ad- 
vantages over nativistic, built-in problem solutions, the situation is such 
that we can, on occasion, fall flat on our collective face We pride our- 
selves on our flexibility and freedom, but the attendant responsibility 
and risk are also great 

In a work such as the present one, it is not our task to explore those 
innate mechanisms which insure social competence in certain of the 
low^er organisms In fact, by their very nature these mechanisms are 
antithetical to the phenomenon we know as learning But we must 
recognize their reality and, more than this, have some appreciation of 
what a momentous thing it was when our progenitors made the transi- 
tion from this sort of animal world into our distinctively human one 
This IS not to say that this transition was necessarily sudden or m any 
sense absolute, but it was nonetheless tremendous and deserves our 
deep interest and respect 

There was a period, some decades back, when the concept of instinct 
was so over- worked, especially by unjustified extension into human 
affairs, that it came into general disrepute However, there is a current 
revival of interest therein on a much more modest, and therefore 
sounder, scale Among modern students of the problem, none is more 
articulate and astute than Professor N Tinbergen, of Oxford Univer- 
sity, and we shall rely heavily upon Chapter V of his 1953 book. Social 
Behavior in Animals, for the summary knowledge of this field with 
which we shall here have to be content By way of reviewing earlier 
chapters, Tinbergen says 

In the preceding chapters I have tried to show that social co-operation 
serves a great variety of ends Mating behaviour is not merely the act of 
coition, but is preceded by long preliminaries These preliminaries, or court- 
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ship, ha\e very distinct functions It is necessary that the two partners are 
brought together Their activities must be synchronized The reluctance 
against bodily contact must be o\ercome Inter-specific matings must be 
prevented The female must appease the male’s aggressu eness \\ e have 
seen that all these functions are served bv^ a signalling svstem, b> which one 
individual can influence the other’s behavior In familv life, the behav lour of 
the parents has to be co-ordinated so that they take turns in guarding the 
eggs or young When the young are to be fed, or w hen the\ must be \\ arned 
against a predator, close co-operation, often involving mutual signalling, is 
necessary Several of the relationships of familv life extend bev^ond that into 
group life, and here again we found that co-operation was based on signal- 
ling Finally, I argued that fighting, and especiallv reproductive fighting, 
although in some respects a disadvantage to the individual, is of great use 
to the species, because it effects spacing out and thus tends to prevent harm- 
ful over-crowding Since actual fighting inflicts damage as vv ell as effecting 
spacing-out, a signalling system such as exists in most species, vv here damage 
IS reduced to a minimum while the intimidating effect is retained, is to the 
species’ advantage Threat display reduces fighting in tw o w av s if shown bv 
an owner (of a territory, a female, a hole, etc) it intimidates rivals If 
shown by a trespasser, it marks the latter out for attack, and thus enables 
an owner to leave harmless intruders alone Again, these functions depend 
on signals 

The signalling system has been studied in a number of cases Although 
much more work has still to be done, some general conclusions are alreadv 
possible 

We have seen that the parent Herring Gull feeds the chicks bv" regurgitat- 
ing some food, and presenting part of it to the young, keeping it betw een the 
tips of the bill The young gull is first roused by the “mew call” of the parent, 
then It pecks at the bill tip, clearly guided by visual stimuli, until it gets the 
food in Its bill, when it swallows it The v^-arious signals, auditory and v isual, 
are given by the parent and reacted to by the chick In discussing such signal- 
ling systems, I will call the individual presenting the stimuli the actor, and 
the individual responding to the stimuli the reactor (pp 72-73) 

The observations just cited are of great impoitance and fit well wath 
earlier discussions in this volume For example, one is immediately re- 
minded of the passages quoted in Chapter 4 from G H Mead concern- 
ing the difference between signals and symbols, and it is noteworthy 
that Tinbergen speaks of the former, in connection wath his animal 
studies, but does not allude to the latter concept at all In Chapter 2 and 
4 we have seen that lower animals are capable of making and respond- 
ing to simple mediating responses (“pure-stimulus acts”) and of thus 
showing foresight and even insight (see Chapter 6) of a limited kind, 
but It is also clear that there is, in the general social interaction of living 
organisms in a state of nature, a system of communication which is 
surprisingly direct in its action and which involves, it would seem, 
virtually no mediation In order for language and the higher mental 
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processes as w e know them in human beings to emerge, it is as if the 
very basis on w hich animal “language” has developed had to be aban- 
doned and a “new start” made, along radically different lines As noted 
in Chapter 2, there is a limited sense in which even an emotion is a 
mediator, but in Chapters 4 and 5 we discovered that in order to have 
human language, representational mediators, in the form of linages^ 
must also be freely available Is thii, the development which made hu- 
man mentality uniquely possible^ There is some evidence of imagery 
in low^er animals, so the difference here is apparently one of degree 
rather than kind, and w’-e are left with no sure understanding of precisely 
w^hat It IS that preserves that subtle, yet impenetrable, barrier between 
the human and the nonhuman 

Tinbergen continues his analysis as follows 

Turning now to the reactor’s behavior, we find again that it is innate The 
Herring Gull chick aims its pecking response at the parent’s bill tip from the 
first, without having to learn it The male Stickleback raised in isolation 
reacts to other males by fighting, to females by courting It could not have 
learnt this In other words, it is not only the capacity to perform these 
motor patterns that is innate, but their sensitivity to special releasing and 
directing stimuli as well (p 78) 

In many of the other animals that have been studied we find that the re- 
actor, just like the gull chick, responds to a few selected stimuli provided by 
the actor As w^e have seen, the fighting of the Robin is released by the red 
breast more than by any other bodily character The male Stickleback’s 
fighting IS released by the red underside more than by anything else The 
male “moustache” of the Flicker overrides the influence of any other char- 
acter, and so on It seems as if such colors, shapes, calls, movements, have 
but one function the release of fitting responses in the reactor This idea 
was first clearly put forward by Lorenz (1935) [see also 1937], who pointed 
out that social responses are often released by such features, which seemed 
to be specially adapted to this function Such organs he called releasers 
Lorenz described this concept of releaser in the following words “The 
means evolved for the sending out of key stimuli may lie in a bodily char- 
acter, as in special colour design or structure, or in an instinctive action, 
such as posturing, “dancing” and the like In most cases they are to be found 
in both, that is, in some instinctive acts which display colour schemes or 
structures that were evolved exclusively for this end All such devices for the 
issuing or releasing stimuli, I have termed releasers (Ausloser)^ regardless of 
whether the releasing factor be optical or acoustical, whether an act, a 
structure, or a colour ” 

The evidence which is now accumulating through the work of a number 
of workers in this field seems to confirm Lorenz’s hypothesis in the mam 
In a very few cases is the evidence complete enough, and much more work 
remains to be done, but on the whole the principle of releasers seems to be a 
very useful one for understanding the mechanisms of social co-operation 
(pp 80-81) 
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After a detailed re\ie\\ of leleasers which imolve sounds, chemical 
signals, and touch and \isual stimuli, Tinbergen concludes his anaKsis 
thus 

So far as our present know^ledge goes, social co-operation seems to depend 
mamh on a system of releasers The tendcnc\ of the actor to 2ji\e these 
signals IS innate, and the reactor’s responses are likew ise innate "Releasers 
seem alw a\ s to be conspicuous, and relam eh simple This is significant, be- 
cause we know from other work that the stimuli releasing innate beha\iour 
are alw a\ s simple “sign stimuli ” It seems therefore as if the structures and 
beha\ lour elements acting as releasers are adapted to the task of pro\ iding 
sign stimuli When releasers ser\e, in addition, the function of rcproductue 
isolation, they are specific as w ell, that is, different from releasers in other 
species This specificity cannot ahvavs be attained b\ one single releaser, but 
a sequence of releasers, each in itself not v er} specific, can in its entiretv be 
highly specific 

Not all communication, howe\er, is based on releasers, there are certain 
complications As we ha\ e seen, man\ social animals respond to the species’ 
social releasers only when provided by certain indmduals, which they 
know personally In such cases personal connexions, established through learn- 
ing processes, confine the reactor’s responses to signals from one or a few 
individuals onh , the\ still respond to the releasers of the species, but only 
after they ha\e narrowed their attention to particular members of the 
species 

The reactor’s responses are sometimes immediate and simple movements 
Often, however, they are internal responses, the signal in such cases changes 
the reactor’s attitude and prepares it for a more complicated and variable 
activity 

We see therefore that a community functions as a result of properties of 
Its members Each member has the tendency to perform the signal move- 
ments releasing the “correct” responses in the reactor, each member has 
specific capacities that render it sensitive to the species’ signals In this sense 
the community is determined by the individuals (pp 85-86) 

Tinbergen extends his analysis to include the signalling that occurs 
not only within a given species but also betw een diflFerent species and 
elaborates this general appioach in other illuminating ways However, 
for our purposes these are not directly relevant and cannot be pursued 
in this context But it would be a mistake in a chapter of this kind not 
to make at least passing acknowledgment to the very substantial w^ork 
which has been done in this area and to the realities with which this 
work has very properly been concerned 

111 Imprinting and 'Xritical Periods'' 

From time to time in this and the antecedent volume, reference has 
been made to the phenomenon of mstmet^ as a type or pattern of be- 
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havior ^vhose occurrence is evidently dependent upon the mere matura^ 
tion or growth of the nervous system, quite apart from experience oi 
learning, and it has been conjectured that such behavior is most likely 
to be present either (a) where the environment is extremely constant or 
(b) w^here biological issues are at stake which are so vital that they 
cannot be left to the vicissitudes of individual learning Within the past 
century, a somewhat intermediate phenomenon has been discovered 
w^hich IS of special relevance to the social life of living organisms This 
IS the phenomenon of imprinting (Beach & Jaynes, 1954) 

In a now classic paper, published in 1937, Konrad Lorenz dates his 
career as a naturalist from one Easter when, as a small boy, he was given 
a baby duck Somewhat to his surprise, but delight, he found that the 
duckling was soon following him faithfully wherever he went, and 
child though he was, he realized that he had become a bone fide “mother 
substitute” for the little creature So fascinated was the boy by this 
behavior that although he was later educated as a physician, his major 
interest and vocation throughout life have remained that of naturalist 
and sagacious student of bird behavior (cf Section II) 

As a result of extensive observations, both in the field and under 
semi-expenmental conditions, Lorenz has developed the concept of 
“impimting,” a notion lying somewhere between instinct and learning 
(cf Spaulding, 1873) Many young birds, it seems, have a tendency, 
as soon as hatched, to follow the first moving object they see Normally 
this IS the mother bird, but if the circumstances are ^inormal, this 
object may be a human being, a foster mother of a different species, or 
even an inanimate object Here there can be no question of the behavior 
being dependent upon secondary reinforcement — for there has, as yet, 
been no primary reinforcement But a learning of sorts is clearly in- 
volved, for the initial and somewhat fortuitous attachment to the 
“mother” becomes stable and differential After a short time, the young 
bird will respond in this way to 7 io other bird or object, and remains 
fixated upon the one it has thus “imprinted ” However, if separation 
from the original mother occurs, a second “imprinting,” or “adoption,” 
can take place, as the story of Lorenz’ Easter duckling indicates Heie 
It seems that well known learning principles are involved ^ 

In order to sharpen the concept of imprinting and to avoid the 
possible errors of casual or field observations, Jaynes (1956) has made a 
careful laboratory study thereof, which he summarizes thus 

Tor a more detailed discussion of this point, with special reference to the prob- 
lems involved in getting Seemg-Eye dogs properly attached to their masters, see 
Chevigny (1946), also Mowrer (1950, Chapter 24) 
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Imprinting phenomena \\ere studied in i8 domestic neonate chicks An 
apparatus [Fig 10-5] \\ as used in -w hich the \ oung birds, \\ ith no obser\ able 
re-s^ard, developed following and approach responses toward a cardboard 
object which mo\ed irregularlv" about a lo-ft alle\ Four experiments were 
performed to investigate the development of these responses on the first 
four days after hatching and their generalization The conclusions reached 
are as follow s 

1 The reaction of neonate chicks to a moving object is not mereh a 
following response, but it is a matrix of responses including attention, 
vocalization, approaching, and following, usuallv in this order 

2 The reaction appears suddenh^ within the first few minutes of ex- 
posure, and dev elops progressiv ely in the first half-hour Gradual improv e- 
ment occurs over the first four days, probably due to general maturation 

3 There are innate preferences m neonates of this species, for some 
objects prove better cues for imprmting purposes than others of approxi- 
mately the same size 

4 Birds show a decrement in responding upon introduction of a strange 
object m place of the object with which they were trained 

5 The amount of generalization decrement is somehow dependent upon 
the characteristics of the stimulus used in training 

6 After four days of training, chicks approach the objects to which they 
have been trained in preference to other objects in a choice situation, the 
time taken to do so dependmg upon how well they have followed the object 
previously (p 206) 



Fsg 10-5 “Apparatus for the study of filial imprinting in birds An object (a 
cardboard cube in the figure) is suspended on a pulley svstem, so that it moves 
irregularly about a lo-ft alley Lengthwise dimensions in this diagram are shortened 
for purposes of illustration” (Javmes, 1956, p 202) 


By way of further interpreting his findings, Jaynes says 

The experiments prove that without any observable reward young birds 
of this species follow a moving stimulus object and very rapidly come to 
prefer that object to others The first appearance of this response occurred 
shortly after exposure to the object and was invariably preceded by distmct 
changes in vocalization in reaction to it Thereafter, locomotor responses 
to the movmg object increased in frequency and vigor Both practice and 
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ph\ siological maturation appeared to be responsible for improvement over 
the first feu days of life Previous reports that imprinting is suddenly ac- 
quired are thus substantiated in part, but that practice plays an important 
role is indicated by the graphs [shown in Fig io-6] 



Fig 10-6 “Three typical curves for the de\elopment of imprinting on the first 
day of life during a %-hr session Scores are the number of seconds spent within 
a foot of the moving object during a 5-minute inter\ar’ (Jaynes, 1956, p 203) 

Imprinting has been called “irreversible,” and thereby distinguished from 
other arrangements for learning This could mean two things (a) that it 
IS never forgotten, and (b) that once an object induces the following re- 
action, other objects cannot do so The latter is clearly untrue, at least in 
the neonate period of the species studied, since considerable generalization 
occurred to quite dissimilar objects (p 205) [See also Jaynes, 1958a, 1958b ] 

Although It IS not easy to identify any element of reward in the 
experimental situations described by Jaynes (see also Moltz & Rosen- 
blum, 1958), there are many other recorded cases (not usually thought 
of as ‘‘imprinting” but manifestly similar) where conventional learning 
principles may very well apply One such example has been extensively 
studied by Scott (1945) investigator was concerned with the 

genesis of “leadership” as it is manifested in sheep and other species 
where the herd or flock characteristically follows a leader Contrary to 
what might seem a reasonable expectation, it is not the strongest and 
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most aggressive male that t\picalK plavs the lole, it is rather, for 
sheep, the ewe with the largest number of descendants m the group 
She, ordinarily, is one of the oldest members of the flock and is perhaps 
quite feeble in the bargain, but she nevertheless has an emotional \alue 
for the other sheep w hich make them w ant to follow and be w ith her 

In the light of what we think we know about the principles of 
learmng, w^hat can w e say about this observation^ Clearly, as a result 
of nursing her lambs, a ew^e takes on secondarv reinforcement, i e , be- 
comes positively “cathected,” for them, but we might expect this situa- 
tion, of aflFection and attachment, to be of limited duration Nutri- 
tionally, lambs must eventually be weaned, and we would expect the 
mother, at this point, to lose her attraction for them In some species, 
this appears to be precisely what occurs the young and the mother 
may separate or, even though remaining in the same vicinit\ or e\en 
in the same social group, they may later have no special interest in 
each other Can it be that the mother sheep, though no longer providing 
milk, usefully serves as a guide to “greener pastures,” water, shelter, 
and the like^ If so, this might keep up the attachment to and dependence 
upon her for a while, but, ultimately, one would suppose that the lamb 
w ould “know’' it all” and strike out independently 

Or, might It not be that at this point the lamb stays on w ith the flock 
for protection^ While perhaps a secondary consideration, this is cer- 
tainly not the primary one, for much the same tendenev^ tow ard “flock- 
ing” will be seen in a protected pasture as on an open, and more 
problematic, range That the original nursing situation is somehow 
crucial IS indicated by the observation, also reported by Scott, that 
bottle-fed and “pet” lambs never become properly integrated w ith the 
flock They will be seen grazing alone, perhaps quite far from their 
fellow^s, and seem much more positively oriented toward human beings 
than toward their own species At least as far as other sheep are con- 
cerned, they are “social isolates ” Like birds that are taken from the 
company of their owm kind and induced to “identify” with human 
beings, at least to the extent of “talking,” pet lambs, insofar as they 
can, seem to act more like people than like sheep They have been 
‘Sveaned” from their own kind in a triple sense — nutritionally, emo- 
tionally, behaviorally — and “cathected” instead to members of a dif- 
ferent species ^ 

Both in imprinting and in instances of cathexis established through 
obvious rewards there is, however, a tendency for the “impressionable” 

®See McCulloch & Haslerud’s (1939) study, “Affective Responses of an Infant 
Chimpanzee Reared in Isolation from its Kind ” Cf also Chapter 3 
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period to be limited to the early peiiod of life From this observation 
has developed a concept of “critical periods,” of which Scott (1958b) 
has recently \\ ntten 

What IS the critical-period hypothesis^ In the first place it is in certain 
respects no longer a hypothesis but a well-established generalization which 
can be stated as follows All highly social animals which have been so far 
studied shou early in life a limited period in which the group of animals 
with which the mdividual will form positive social relationships is deter- 
mined To take a few of many examples, the slave-making ants grow up, 
they become attached to their captors [much in the manner of children 
“stolen” by the Comanche Indians] and take care of their young, and no 
longer recognize their own species The experiments of Lorenz with newly 
hatched greyleg geese which quickly form a social bond with the first 
moving object they see, whether goose or human, have dramatized the 
findmgs of Heinroth and others that contact with the young birds m the 
proper stage of development establishes a strong social relationship regard- 
less of the species concerned Lambs that are taken at birth and raised on 
the bottle form social relations with people rather than with sheep and 
become as a result quite unsheeplike in many respects The dog is particu- 
larly interesting because the process of socialization with human beings is a 
normal part of its life as a domestic animal Dogs are more closely attached 
to people than are many animals, and develop a relationship which is in 
many waj^s similar to the human parent-child relationship Furthermore, the 
critical period for socialization in the dog does not begin at birth but ap- 
proximately three weeks later 

The existence of critical periods for the process of primary socialization 
can therefore be taken as established Other parts of the critical period 
hypothesis, namely, that there exist certain periods of sensitivity to psycho- 
logical damage, still remain as hypotheses and need a great deal more experi- 
mental evidence before they are accepted (p 42) [see Section III] 

Although some species (eg, the African Grey Parrot) can still 
be tamed and trained at the adult level, taming is certainly vastly 
easier — and, in some species, possible only — ^in the young Fiom the 
standpoint of familiar learmng principles, conjectures have sometimes 
been made as to why this should be the case (Mowrer, 1950, Chapter 
24) , but the fact is, the phenomenon is not well understood and may 
well involve a pre-arranged mechanism (“imprinting”) of some sort 
Whatever the explanation, this matter of social attachment or fixation 
IS of great importance for group formation and the emergence of 
sociality in general, as we shall shortly see 


IV. Domestication, Socialization, and Group Life 

How did group life evolve^ What are its advantages, and disad- 
vantages, in comparison with a solitary existence^ What are the mech- 
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anisms whereby members of a given (or different) species are inducted 
into the life of the groups These are questions to which we have at 
least tentative answers and which are manifestlv related to the psy- 
chology of learmng 

Group life seems to have originated from one or both of the follow - 
ing biological circumstances parent-offspring and sibling relationships 
It has already been noted that group formation (flocking) in sheep 
follows a matriarchial (ew e-lamb) pattern, and King (1956a), obser\ing 
the domestic guinea pig under “semi-natural conditions,” found that 
the social group is essentially an extended (polygamous) family, con- 
sisting of a male, several females, and offspring But Scott (1958b) 
reports a different pictuie for wolves and the domestic dog 

In dogs there is a close association between mother and puppies durmg 
the first 3 weeks of life, but since the permanent social relations of the 
puppy are formed after this period and at a time when the mother leaves 
the litter for long periods, the result is that the strongest relationships are 
formed wuth the litter mates This relationship is m turn the basis of pack 
organization of adult dogs and wolves (p 43 ) 

And elsewhere Scott (1954) says 

The social group of the wolf is the pack, which seems to be based on a 
litter of animals which grow up together Occasionally the pack may be 
founded by a smgle pair and a litter which stays on as adults, but the young 
litter ordinarily move out of the territory to form new packs As described 
by Murie (1944), the home life of wolves is highly peaceful and cooperative 
A certam amount of dominance is exhibited while feedmg, but the members 
of the pack get along well together even when more than one male is 
present Strange wolves, however, are violently repulsed and drwen off (pp 

742-743) 

Here, then, we see the beginnings of what anthropologists call the 
in-gioup and its counterpart, the out-group and the stranger King 
(1954) begins a paper on “Closed Social Groups among Domestic Dogs” 
thus 

Many social animals form groups which are closed to other mdividuals 
of the same species Strangers attempting to enter a bee hive (Butler and 
Free, 1952), an ant colony (Wheeler, 1923), a school of swordtail fish 
(Noble and Borne, 1940), a chicken flock (Collias, 1944), a group of 
howlmg monkeys (Carpenter, 1934), or a wolf pack (Murie, 1944) are 
driven off, severely beaten, or killed The repulsion of the stranger may be 
undertaken by a specialized member of the group or by the united efforts 
of the entire group In some species, such as ants, the individuals specialized 
for excluding strangers may be even morphologically distinct from other 
members of the group In other species, such as prairie dogs (King, 1951), 
all of the group members may cooperate to expel a stranger from the group 
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These extremes in morphological and social specialization suggest that 
the preservation of group integrity is a fundamental adaptive mechanism 

The study of closed social groups has been limited principally to life 
history descriptions of a particular species or to the phenomenon of terri- 
toriality [see Howard, 1920], which stresses the defense of an area rather 
than the preservation of group composition The former studies have 
shown that closed societies exist at many phylogenetic levels throughout the 
animal kingdom (p 327) 

Although the ascendancy-submission hierarchy, or “pecking order,” 
of a social group may at first seem to be inspired completely by 
competition and hostihty, yet there is some evidence that such a hier- 
archy represents the begmmng of social order As Scott (1958b) has 
observed, “A dominance order may be thought of as an adaptation for 
reducing destructive fighting in a group” (p 159) And the sociologists, 
Sumner, Keller, & Davie (1928), maintain that even in human society 
cooperation always has a substratum of “antagonism ” On the basis 
of this type of thinking. King then concludes 

Since [m the dogs observed] the group members formed a social hierarchy 
by aggressive behavior, they were conditioned to react aggressively toward 
individuals like themselves By this process of conditionmg of the group 
members to each other, any socially structured group may be closed to 
strangers (p 336) 

In other words, the hypothesis is that because of suppressed hostihty 
toward each other, the members of a social group immediately feel, by 
generalization, hostility toward strangers of the same species and variety 
toward whom there is no restraimng affection or mutual fear The 
difficulty with this argument is, of course, that it does not explain why 
the latter emotions do not also generalize The httle-understood mech- 
amsm of jealousy, if carefully investigated, might bring us closer to 
the facts of the situation 

Perhaps our best insights concermng the mechamsms whereby the 
young of a given species normally socialized, 1 e , prepared for group 
life among their own kind, come from observations concermng the 
process commonly known as domestication, 1 e , the adjustment of an 
individual or individuals of one species for hfe m the social group of 
another species As we have seen (Chapter 3), certain kinds of birds 
can be so completely weaned from their own species that they adopt 
the noises (words, laughter, singing, etc ) of human beings and may 
even lose sexual interest in their own kind (Mowrer, 1950, Chapter 24) 
The alienation of “pet” lambs has also been cited in the present chapter 
And Scott (1954) has an excellent paper on “The Effects of Selection 
and Domestication upon the Behavior of the Dog ” According to Scott 
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and other authorities the dog sprang ('some 8000 years ago) from a 
domesticated variety of wolf (cf Lorenz, 1955), under the following 
reconstructed circumstances 

A primitive hunting tribe in Europe or Asia may very easily have fallen 
into a commensal relationship with wolves with the latter frequenting the 
village refuse heap and the human inhabitants finding it profitable to rob 
the wolf dens at times when food was scarce At some point, a young wolf 
puppy was caught and adopted by the people and nursed and fed by them 
This animal would consider the human group as its society and would be 
peaceful and tolerant toward them, and as it grew older w ould ha^ e a ten- 
dency to go out and hunt and bring back food to the village It would reject 
wild wolves except at the time of matmg and m due course other wolf 
puppies could be raised in the village and be socialized with respect to man 
(P 743) 

Here mutual dependence is the key to domestication (socialization), 
and we can assume that some measure of mutual annoyance or resent- 
ment will be tolerated by virtue of that dependence This line of 
thought has been perhaps most fully and explicitly developed by 
Carpenter (1952) in his monograph on “Social Behavior of Non-human 
Primates ” Because this study is based upon extensive first-hand field 
observation and involves theoretical constructs which readily articulate 
with revised two-factor learmng theory, the following extended excerpt 
IS quoted 

Integration of Societies of Non-Human Primates What are the processes 
which result in the formation of simian primate societies^ What processes 
cause such associations to persist as identifiable groupmgs for relatively long 
periods of time^ What are the counter-acting processes which result m 
mdividuals leavmg the groupings or the division of the societies^ Cur- 
rently It IS proposed that answers to these questions may be given in terms 
of genetics, maturation and growth, motivation and learnmg 

(Senerally conceived, there are two clusters of interacting processes 
which may be defined There are those processes which have a centripetal 
effect on individuals which form groups, and there are those processes which 
have a centrifugal effect When the centripetal process predommates for all 
individuals, none leave the society, it has a high degree of cohesion When 
the centrifugal forces predommate for the group, mdividuals may leave the 
group, It has a low degree of cohesion Thus, the centripetal and centrifugal 
processes mteract and result m varying degrees of group cohesiveness and 
dynamic stability It is proposed that the vector sums of the centripetal and 
centifugal forces equal the degree of group cohesiveness 

Genetic and maturational processes are conceived to operate to mcrease 
to some degree the probability that defined patterns of behavior will occur, 
as they do occur, and more frequently than on the basis of chance alone 
Not only the anatomical but also the associated behavioral patterns like 
locomotion, graspmg, vocalizations and some aspects of perception, are 
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peculiarly characteristic of some genera, and thus may be said to be princi- 
pally determined by the process of genetics plus maturation Furthermore, 
the basic or primary needs or drives like temperature demands, intake needs, 
prepotent motor responses like sucking, clinging or grasping and sexual 
acti\ ities, as w ell as prepotent avoidance responses are initially, basically and 
predommateh the expression of genetic, maturational and adjustment deter- 
miners 

This reasoning leads to the formulation of an important prmciple for 
understanding the dynamics of group integration Namely, that the drives ^ 
tensions or needs of one individual which are satisfied by activities of an- 
other individual or mdividuals of a grouping modify the previous adjust- 
ments between or among the individuals This may be termed the principle 
of reciprocal interaction 

The following will illustrate this principle Given a female and her new- 
born mfant the stage is set for the operation of the process of reciprocal 
interaction The female has normally a set of activated needs or drives which 
the infant, as a cluster of incentives, appropriately satisfies Reciprocally, 
the infant has at birth a set of activated needs or drives which the female 
satisfies as a complex of appropriate incentives The female eats the placenta 
and umbilicus She licks the amneotic fluids from the infant She holds 
and guards the neonate The mfant is predisposed to cling to the hair or 
fur of the female It responds positively to her warmth and protection It 
avoids movmg away from the female It avoids other animals Presently it 
nurses Thus, conditionmg prmciples are adequate to explain the building 
up and the reinforcement of specific, positive reciprocal interactions be- 
tween the two organisms the female and her infant [cf Harlow, 1958] 

As the mfant grows it explores more and more It explores itself, its 
mother, nearby space and objects It explores other young monkeys and 
they respond positively or negatively to it Play, first individual, then social, 
emerges Both positive and negative responses to an increasing number of 
other members of the group are elaborated through reciprocal condmonmg 
and learnmg The young monkey learns to react positively to some indi- 
viduals and classes of animals and to avoid others Motor patterns of 
offense, defense and escape mature and are exercised Long before the 
young monkey has adequately matured physiologically for primary sexual 
behavior, motor aspects of these activities are expressed and exercised Dur- 
ing play the young monkey may frequently be observed mountmg and 
being mounted Gradually the mfant gams statuses and learns to behave 
appropriately with reference to other individuals m their statuses It becomes 
socialized 

If the growmg young one is a male, it must compete successfully with 
all other males or leave the group If it is female, its adjustments within the 
group are stimulated, facilitated and reinforced by means of sexual and 
other varieties of behavior 

Sexual behavior especially affects group mtegration according to the 
prmciple of reciprocal interaction The estrus female with her activated 
drive for copulation provides for the responsive males of a group a set of 
mcentives which satisfy the drives or reduce the tensions of the males The 
mteractional responses mvolved in primary sexual behavior positively rem- 
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force these social responses They may become generalized through con- 
ditioning and learning with the effect that the probabilities are mcreased 
for the reoccurrence of posime interactional acmities other than sexual 
among the individuals Comersely, the probabilities are reduced for the 
occurrence of negative or antagonistic behavior 

Accordingly it is reasonable to assume that the operation of the principle 
of reciprocal interaction, in a great manv kinds of social behavior, results 
in the development and maintenance of a network or matrix of frequenth 
recurrmg positive interactions These integrate the individuals with a struc- 
tured grouping These are the centripetal forces w hich attract the animals to 
each other, regulate their interactions and cause the society to persist as an 
identifiable group 

Territorial adaptations and interactions wuth other groups, le, attacking, 
bemg attacked or threatened by attacks are conceived to reinforced the 
over-all integration of non-human primate groups 

Competition, conflicts and v arious forms of aggression, w hich are integral 
processes of the simian primates’ social behavior, also operate within the 
limits of the prmciple of reciprocal interaction to differentiate the statuses 
of individuals, to create mtra-group stresses and to cause some individuals 
to leave the society There are also extra-group incentives for individuals 
which do not have their needs satisfied within the organized indigenous 
group These are the centrifugal forces which, when strong enough, result 
in dispersions of group members or the actual disintegration of the societ) 

Summary Statement The integration of societies of non-human primates 
consists of processes which lead to centripetal and centrifugal effects It is 
believed that explanations of the social integrative processes can be stated 
in terms of genetics, maturation, motivation and conditioning or learning 
A general prmciple of reciprocal mteraction is proposed This principle 
applies to the interactions of orgamsms between or among which there are 
reciprocal satisfactions of needs, drives and tensions Female-infant mter- 
actions, the mteractions of young ammals durmg play and male-female 
primary sexual behavior are cited to illustrate how the prmciple operates to 
increase the probabilities of the occurrence of positive mteractions Terri- 
torial adaptations and mteractions with other groups of the same species are 
believed also to reinforce group mtegration Conflicts and attacks have 
negative or opposite effects (pp 243-244) 

In Figs 10-7 and 10-8 we see some of the situations which, according 
to Carpenter, make for social cohesion or disruptions and, we may 
add, individual happiness or misei\ 

Carpenter’s analysis lends itself admirably to restatement in terms 
of revised two-factor learning theory In fact, it is, in itself, almost 
such a statement To begin with, there are the piimary rewards and 
punishments which are mediated by group living These are, on the 
one hand, food (especially for the young), shelter and mutual protec- 
tion, and sexual gratification and, on the other hand, the aggressions 
which arise as a result of unregulated competition for the available 
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rewards To the extent that an individual experiences rewards in the 
group, various forms of stimulation associated with group hfe take 
on secondary reinforcement and tend to hold the individual in the 
group To the extent that an individual experiences punishments in the 
group, the associated stimuli take on the capacity to arouse fear and 
tend to 7 epel^ or “expel,” the individual Hence the image of “centrip- 
etal” and “centrifugal” forces acting upon each individual in the group 
which thus determine, for the group as a whole, its stability or in- 
stability 

But It goes \\ ithout saying that a given individual does not have the 



Fig 10“7 Socially reinforcing behavior in monkeys (courtesy of C R Carpenter) 
Mutual grooming, mothering, and sexual behavior are cohesive forces, tending to 
preserve group life 
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same experiences with each and ever)- member of the group More or 
less strongly differentiated reactions from other individuals may be 
predicted on the basis of sex, age, strength, etc Hence, each individual 
learns to react selectively, discriminatingly toward other members of 
the group, w^hile at the same time establishing attitudes of friendship 
or enmity on the part of others toward him All of w hich leads to w hat 
Carpenter has briefly alluded to under the head of “status” and to 
which might w^ell be added the notion of ? ole 



Fig TQ-8 An outcast male monkey (courtesy of C R Carpenter) Compeution and 
fighting for food and mates are socially disrupuve and someumes drive mdividual 
animals out of a group 

Hence, m a stable, successful social group the total learning associated 
with life in the group is relatively great Carpenter, following common 
practice, has termed this socialization Yet in even the most highly 
integrated animal groups, both the amount and the “quality” of social 
learmng seems elemental and primitive m comparison with the social 
learmng which occurs at the human level It is nevertheless useful to 
see group life and group-mediated learmng in its elemental, relatively 
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unelaborated form For it is piesumably out of such a setting that 
human society, culture, and personality have evolved, and it still 
provides the rudiments of social, personal, and interpersonal reality 

V Further Analysis of Social Learning and Group Structure 

As between considerations advanced in Sections II and III of this 
chapter and those just reviewed in Section IV, the reader will no doubt 
feel some strain and inconsistency The work of Lorenz, Tinbergen, 
Jaynes, and others suggests that, at least in a state of nature, social 
action and organization in animals are mainly determined by innate 
mechanisms (instincts, releasers, etc ), w^hereas in the immediately pre- 
ceding section, considerable evidence is advanced foi believing that 
individual experience and learning are of paramount importance How 
can this difference in emphasis be reconciled^ Two points should be 
specifically noted 

1) While stressing innate determination of social responses, Tin- 
bergen does not by any means exclude individual learning, and Carpenter 
likewise does not say that motivation and learning are exclusively re- 
sponsible for the shaping of social acts and attitudes With these varia- 
bles he also includes “genetics and maturation ” Hence, the difference, 
in any case, is relative rather than absolute 

2) Careful review of Sections II and III and comparison with Sec- 
tion IV will indicate that the writers cited are, by and large, interested 
in different species, and even phylla The investigators first mentioned 
draw heavily upon observations with birds and fishes, whereas the 
others are interested mainly in higher marrmals sheep, dogs, primates 
And it IS noteworthy that the studies cited in Section I were likewise 
concerned, exclusively, with mammals 

Hence we emerge with the plausible induction that although some 
genetically determined, maturational factors are undoubtedly involved 
in the development of social hfe in mammals and that learning some- 
what influences the social life of other phylla, such as birds and fishes, 
there is, nevertheless, a broad difference to be noted here between 
the relative importance of each And since human beings have a mam- 
mahan background and have become very highly specialized in adapta- 
tion through learning, this difference in emphasis makes complete 
sense and shows that already in other mammals there is, so to speak, an 
anticipation of and preparation for the trend which was to become so 
outstanding at the human level and is so very different from the nativ- 
istic mechanisms of other phylla 
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In this section we shall be particularly concerned with certain new 
experimental techmques and concepts which seem to have special 
promise for further clarifying and consolidating ammal experimenta- 
tion and learmng theory, on the one hand, and human personality and 
social phenomena, on the other Let us consider, particularly, two 
studies recently reported by J V Murphy and associates In 1955, 
Murphy, Miller, & Mirsky performed an mgemous experiment on w hat 
they called “Interammal Conditiomng in the Monkey ” By w^ay of 
introduction they say 

Dramatic changes m individual and group behavior ha\e been reported 
m studies of experimentally mduced “neurotic behavior” Gantt (1944) has 
observed such phenomena m his dog Nick Liddell (1953) made similar ob- 
servations with sheep, and Masserman (1943, 1953) has reported extensue 
behavioral changes m cats and monkej'S Although many investigators have 
been aware of changes m the social interactions of animals after a series of 
conditioning experiences, it is noteworthy that no controlled experiments 
on mterindividual conditioning have been reported 

Laboratory studies of avoidance conditioning typically have been re- 
stricted to conditioned stimuli such as lights and tones It is not, however, an 
inherent aspect of the phenomenon which imposes this restriction The 
present study was designed to demonstrate that one monkey can be success- 
fully utilized as the stimulus for conditioned avoidance behavior in other 
monkeys The specific aim w^as to develop a technique which could be used 
to modify interammal transactions The demonstration of such a possibility 
IS considered relevant to numerous problems in the area of group function- 
ing and personality theory This lack of application of conditioning princi- 
ples to social interaction phenomena is particularly interesting when one 
recognizes the importance of mterindividual transactions in clinical practice 
(P 211) 

The experimental piocedure used by Murphy, Miller, &. Musky was 
simple An apparatus was constructed which consisted, essentially, of 
two compartments, each of which would comfortably hold a monkey, 
with a plate-glass partition betw^een them (Fig 10-9) The experi- 
mental animal, in Compartment i, normally could not see the stimulus 
ammal, in Compartment 2, but by a slight shift in lighting arrange- 
ment, the stimulus animal could be made clearly visible Sight of the 
stimulus ammal was then made the danger signal, or CS, in an ordinary 
active avoidance learning procedure 1 e , five seconds after exposure 
of the stimulus animal, a shock was delivered to the grill floor of Com- 
partment I, unless the experimental animal pushed a response bar wdiich 
caused the stimulus monkey to disappeai and prevented the shock 
Compartment 2 was frequently exposed without the stimulus monkey 
in It, and not associated with shock Therefore, the experimental am- 
mal learned that sight of Compartment 2 was dangerous only if it con- 
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tamed the stimulus monkey, thus focusing attention upon the monkey 
rather than exposure of the compartment as such 



Fig 10-9 Apparatus used by Murphy, Mdler, & Mirsky (1955, p 212) for the study 
of “interammal conditioning in the monkey ” The stimulus animal (in the right- 
hand compartment) becomes \isible to the experimental animal (in the left-hand 
compartment) with a change in illummation The vertical response lever, by 
means of which the experimental ammal can “turn off” the stimulus animal and 
thus avert electric shock, can be seen just m front of the plate-glass w^indow 
separatmg the two compartments The small adjacent box (at the extreme right) 
serv es to house the stimulus monkey during neutral trials 

Results obtained fiom use of this procedure show that, as was to be 
confidently expected, the appearance of one animal can be made the 
occasion for a fear leaction and appiopiiate “avoidance” behavior 
(bar pressing) quite as leadily as can the presentation of some inani- 
mate stimulus such as a buzzei or a light (cf also the Watson-Raynor 
experiment described in Chapter ii, Mowrer, i960) Moreover, the 
method lent itself admirably to the study of geneialization (from the 
stimulus monkey to other monkeys) and discrimination (One often 
wonders to what extent one animal “knows the difference” between 
other ammals of the same species Here, it would seem, is a way to 
find out ) 

In concluding this article, the authors say 

The social avoidance conditioning technique is particularly challenging 
when viewed from a “fear reduction” viewpoint If the sight of the stimulus 
animal gives rise to “fear” in a conditioned animal, numerous predictions of 
inter-animal behavior suggest themselves One application currently under 
mvestigation is the experimental modification of the group dominance 
structure m a group of monkeys 
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The modification of interindn idual beha\ior is presumabK not restricted 
to a\oidance behavior It appears equally feasible to establish approach 
beha\ior or any combination of a\oidance and approach behaMor (p 213; 

It was therefore entirelv^ natural that in 1956 Murphv 8^ Alillei 
should have published a sequel to the study just cited, on “The Ma- 
mpulation of Dominance in Monkevs with Conditioned Fear,” which 
they summarize thus 

Two group-dommance tests were conducted on ten rhesus monlve\s On 
the basis of these tests five pairs of animals adjacent, or nearly adjacent, in 
the hierarchy were given an additional five dominance determinations The 
animal in each pair which received the greater number of raisins m each of 
the seven tests between the two animals was designated as dominant This 
animal in each pair was subjected to a\oidance conditioning with his sub- 
missive partner as the conditioned stimulus After attaining a conditioning 
criterion, each pair of monkeys was given an additional five dominance tests 

After completing this phase tw^o additional group-dominance tests w^ere 
completed An additional three pairs were selected as before and subjected 
to the same procedure The dominance status was found to be significantly 
reversed following the completion of conditioning It was suggested that 
this observation provides behavioral evidence for the presence of fear in 
avoidance conditioning which is independent of the conditioning situation 
(P 248) 

Considering that the fear conditiomng occurred in one situation 
(Fig 10-9) and that the dominance-submission relationship was tested 
in a very different one and that the correct (feai-i educing) response 
in the former situation was bar pressing and in the lattei situation 
deference and withdraw^al, the effect here reported is dramatic indeed 
The findings show that the attitude of one animal tow’ard anothei can 
be altered, not only by pumshment administered by one animal to 
another, but also by the experience of punishment merely in the 
p7ese?2ce of the other animal This is a sort of social “latent learmng” 
(Chapter 2) or “putting thiough” (Mowuei, i960, Chapter 7) The 
experimental possibilities w Inch the method suggests, and their theoreti- 
cal implications, are numeious, as the following paragraph suggests 

The obser\ed modification in mtermdiv idual transactions conform very 
nicely with that suggested by the interpretation of avoidance conditioning 
which emphasizes the presence of fear as an intervening variable The 
modification of dominance provides behavioral evidence for the presence 
of fear in avoidance learning w hich is independent of the conditioning situa- 
tion Recently completed expeiiments on mter animal conditioning m which 
the extinguished response m the previously conditioned animal is reinstated 
at a high level by observing the stimulus animal undergoing painful shock 
stimulation will make it possible to establish more definitive evidence for 
the presence of fear in avoidance conditioning and its communication be- 
tween animals (p 247) [See the discussion of “empathy” in Chapter 3 ] 
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It goes without saying that, using the same apparatus, one could also 
make an experimental ammal come to “hke” a stimulus monkey by 
associating the latter with the presentation of food, water, or other 
decremental primary reinforcement Here there would be an “un- 
earned” increment of liking, or “love,” just as there is an unearned 
increment of fear in the situation actually employed by Murphy and 
associates Artificial though such situations are, they provide, by this 
very fact, exceptional opportumties for the experimental manipulation 
of social relationships 

Gewirtz (i960) has recently reviewed such systematic evidence 
as there is on the process whereby human infants develop positive 
emotional ties to paients and others The most substantial induction 
from this material is that by virtue of the care and protection which 
adults provide foi infants, the former take on the capacity, as well 
known learning principles (Mowrer, i960, Chapters 3-5) would 
predict, to produce secondary reinforcement of either the type-i or 
type- 2 varieties or, more probably, both 

Stone ( 1954) has published a “Critique of Studies of Infant Isolation,” 
which conspire to show the devastating effect, upon both intellectual 
and social development, of the lack of normally satisfying human con- 
tacts, and Thompson & Heron, in the same year, reviewed studies on 
“The Effects of Restricting Early Experience on the Problem-Solving 
Capacity of Dogs” and certain other animals While the type of restric- 
tions alluded to here is somewhat different from the isolation considered 
by Stone, the net result is much the same “adverse effects on the 
problem-solving ability of the adult dog” (p 29) From the analysis 
of language learmng put forward in Chapter 3 and from the whole 
conception of approach behavior and habit formation developed in 
Learning Theory and Behavior^ these findings occasion no surprise 


VI Guilt A Unique Aspect of 

Human Socialization and Personality 

There is, of course, a large and illuminating literature on socialization 
of the human young, both in our own and other societies, but, in the 
main, this lies beyond our present scope or interest Here we shall 
restrict ourselves to a special problem, which, though central to the 
socialization process, has been generally neglected from the standpoint 
of learning theory This problem is the phenomenon of conscience, 
character, or the internalized sense of right and wrong 
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Much of the training which children receive is rather ob\iousl\ 
similar, at least in principle, to teaching and learning procedures studied 
in the animal laboratory Children are taught to shun ceitain objects 
(avoidance learning), to abstain fiom certain actions (inhibition), to 
be attracted by certain objects (approach learning), and to perform 
certain activities (response selection or habit formation) In the process 
they, like our laboratory subjects, develop attitudes of fear and hope, 
experience relief and disappointment, and manifest general patterns 
of timidity or courage They make generalizations, develop discrimina- 
tions and skills and, by principles already considered, learn to talk 

But, with all this, something essentially and distinctively human is still 
lacking the capacity to experience that fateful phenomenon know n as 
gzidt Around the turn of the centur\% a number of empirical studies 
and systematic books were pubhshed on the psychology of religion, 
wherein guilt w^as naturally given an important place But the experi- 
mental psychology of that era, concerned as it w as with sensation and 
perception, had little to say about and less to contribute to the topic 
Gradually, with the ascendance of psychoanalysis, attention was again 
drawn to the problem but in a way which we now suspect of being 
basically mistaken (Section VII) and in a language more figurative and 
poetic than scientific Like the mtrospectionists of an earlier day, both 
Behaviorists and Neobehaviorists, priding themselves on their scientific 
presuppositions, have left the problem almost untouched, and it is only 
recently that serious efforts have been made to interrelate the two 
areas Of these, one of the most useful is a paper published by Ausubel 
in 1955 and entitled “Relationships between Shame and Guilt in the 
Socializing Process ” 

On the basis of incompletely analyzed field observations, a number 
of anthropologists arrived at the view that only in those societies 
embracing the Judeo-Christian tiadition is the phenomenon of con- 
science, or “superego,” to be found in fully developed form and that 
other societies, if they have an orderly moral system at all, depend upon 
the more superficial reaction know as shaine The distinction is, of 
course, familiar in shame the individual is uncomfortable only if 
“found out,” “caught”, whereas in guilt there is self-condemnation and 
self-pumshment regardless of the social situation Many dog lovers 
report clear evidence of shame in these creatures For example, a for- 
mer student of the writer says that his half-grown beagle has very much 
of a “hang-dog” manner w^hen the master comes home if the dog has 
chewed or otherwise mutilated household furnishings during "^■‘e course 
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of the day The mastei need not have yet learned of the damage or in 
any way shown disapproval The dog himself “knows” he is “guilty ” 
But It IS a limited form of guilt and apparently arises only when the 
situation suddenly changes fiom mastei -away to mastei -at-home In 
the former situation the dog is safe, in the lattei, he is suddenly in 
danger, and his behavior changes accordingly In other words, the 
dog not only discriminates between master-gone and mastei -home but 
also between master-home, situation-good and mastei -home, situation- 
bad 

This, manifestly, is the shame reaction Only if the dog, having mis- 
behaved, showed “remorse” or “shame” before the mastei came home 
could we legitimately speak of guilt in the deeper sense of the term 
Here there would presumably have to be a vivid anticipation or fore- 
image of situation-with-master-home, and it is not certain that 
lower ammals are capable of this degree of representational activity® 
Of course, the chances aie that the young beagle, in the case cited, will 
eventually abandon the destructive behavior, but we do not know 
whether it is because his “character” develops or because some of his 
puppish urges (e g , those occasioned by eiupting teeth) simply dis- 
appear (cf Sections VII and VIII) 

Now Ausubel, in the paper cited, makes the eminently reasonable 
point that fully-fledged guilt is almost a certain necessity in the 
members of any well ordered society and that a so-called shame cul- 
ture, such as the Navaho, Samoans, and even Japanese aie said to 
have, simply would not be adequate to its purpose He says 

Without the aid rendered by guilt feelings, child rearing would be a 
difficult matter indeed If children felt no sense of accountability or moral 
obligation to curb their hedonistic and irresponsible impulses, to conform 
to accepted social norms, or to acquire self-control, the socializing process 
would be slow, arduous, and mcomplete And since it is plainly evi- 
dent that the maintenance of perpetual vigilance is impractical, that fear 
alone is never an effective deterrent against antisocial behavior, and that 
the mterests of personal expedience are not always in agreement with pre- 
scribed ethical norms, a social order unbuttressed by a sense of moral 
obligation in its members would enjoy precious little stability (p 378) 

We might expect that guilt feelmgs would be found univeisally, and, 
hence, the burden of proof regarding their alleged absence in a given culture 
more properly rests with the investigator making the allegation (p 379) 

® A nice appreciation of this point is shown by Boisen (1936) when he says “In 
language and imagination we rehearse the responses of others just as we dramat- 
ically enact other consequences We foreknow how others will act, and the fore- 
knowledge IS the beginning of judgment passed on action We know with them 
there IS conscience” (p 17 1) 



SOCIAL LEAR NING AND HUMAN PERSONALITY 393 

But how, precisely, is it that such a “watchdog’ r\usubers term- 
others have spoken of an internal “gyroscope”) is established in the 
growing child? Ausubel’s statement that guilt is ‘a special kind of 
negative self-e valuation a self-ieaction to an injured conscience’ 

IS a good one, and he goes on to suggest that conscience is “an abstrac- 
tion referring to a feeling of obligation to abide bv all internalized 
moial values The injury consists of a self-percei\ ed violation of this 
obligation” (p 379) But there is still need for a mechanism a dynavnc 
whereby such internalization occuis This ilusubel adduces as follows 

Behavior can first be regarded as manifesting moral properties when a 
sense of obligation is acquired The central hypothesis of the present formu- 
lation is that this development typically takes place m children w^ho are 
accepted and intrinsically valued by parents, and who thereby acquire a 
derived or vicarious status in consequence of this acceptance By the fiat of 
parent acceptance they are provided wath intrinsic feelings of security and 
adequacy despite their manifest dependency and incompetence to fend for 
themseh es They accordingly become disposed to accept parental \ alues im- 
plicitly and unconditionally out of loyalty to the individuals to w horn they 
owe their status and self-esteem (p 380) 

In other words, out of his perceived dependency the child decides 
that m hurting significant others (being “bad”) he is really hurting 
himself, and by this route the values of parents and of the larger social 
gioup are internalized, mtrojected, mcoiporated Sometimes it is said 
that the child develops good character by “identifying” with otheis, 
but this formulation is, at best, rathei inexplicit and, at its w^orst, verges 
on circularity to identify with is to become hke others and this is 
precisely what is to be explained The notion of dependency clearly 
suggests obligation, and when w^e aie obligated to others their welfare 
becomes, quite literally, our omi 

And Boisen (1936) puts the same thought succinctly w^hen he says 

The individual judges himself by the standards of those to whom he gives 
allegiance and with whom he wishes to be identified, and to be unable to 
stand before the inner tribunal means for him isolation and destruction (p 

174) 

Could capacity for guilt, as thus conceived, be created and studied 
in the laboratory with ammal subjects? Internalization is by no means 

“^Boder (1949) relates that a small g>psy boy, in a Nazi concentration camp, was 
permitted to accompany his father as he went about the Lager admmistermg beat- 
ings to inmates who had displeased the authorities Soon the small boy was ob- 
served to have found a club for himself and to be “helping” his father Here, 
obviously, was identification or conscience formation which was psychologically 
natural but socially monstrous 
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a new concept to us Fear has been alluded to as ‘‘internalized” trauma, 
Vinacke has characterized learmng in general as “internalization of 
experience”, and Sidman, Schaefer, and others (Mowrer, i960. Chapter 
12) have shown that rats and other laboratory animals are capable of 
responding to internal temporal cues But what, exactly, is it that is 
internalized as conscience^ It is an awareness of and concern for the 
welfare of others, and in our laboratory researches we usually see to 
It that the experimental situation is as impersonal as possible Typically 
the reports of experiments read “The experiment was conducted with 
the subject in an isolation chamber a one-way observation mirror 
was used contact with the experimenter w^as excluded, etc ” And, 
of late, B F Skinner has spear-headed a drive toward the complete 
automation (“programming”) of experimentation, so that the investi- 
gator merely throw^s a switch and leaves the subject alone with a 
preset, pre-instructed machine While extremely useful for some pur- 
poses, this type of research (Skinner, 1958b, has suggested a modified 
version for classioom instruction) is not likely to tell us much about 
either the operation or formation of conscience Those designedly 
“unscientific” and highly per social procedures whereby we care for 
young children or make “pets” of the young of other species are far 
more likely to yield relevant insights 
It may well be, of course, that even with the closest intimacy be- 
tween man and animal, only the grossest rudiments of conscience can 
be established Perhaps, in order for certain representational processes 
presumed to be necessary for conscience to occur, articulate language 
must be available However, the loyalty of dogs to their masters is 
proverbial, and their sense of dependency is clearly manifested, it 
would seem, in their possessiveness and jealousy Thus, by the hypoth- 
esis advanced by Ausubel, perhaps there is the capacity, at least in 
the dog, not only for shame but also for genuine guilt (cf Chevigny, 
1946) and that it could be precisely investigated in the laboratory if 
one were but willing to make the necessary investment of time and 
to disregard some of the rules commonly thought to be essential in 
animal experimentation (see Sections VII and VIII) 

In this book we have repeatedly defended the principle of biological 
homeostasis, le, the assumption that living organisms aie basically 
“selfish” and that they constantly strive to reduce existing drives and 
to forestall their recurrence In the present context, however, we find 
ourselves discussing conscience and concern for the welfare of others 
Does this not squarely controvert the premises on which much of the 
earlier discussion proceeded^ We should remember that, superimposed 
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on his biological substructure, man has a long history of social evolution 
and that in the process of his individual training he is imbued with 
values which, though ultimately based on biological considerations, 
nevertheless transcend them Here, as conscience, a new form of 
homeostasis or equilibrium comes into existence moral eqiiilibriimi — 
and its antithesis, disequilibrium Here conscience, rather than “the 
flesh,” IS of more direct concern, but the continuity is evident Some 
writers have, in various ways, attempted to deny or bieak this con- 
tinuity For example, the theologian R C Johnson (1958), in a series 
of articles on the Apostle Paul, says “All w^ould-be Christianity says 
to us, ‘Obey and be free,’ , but the Christian gospel says, ‘Be 
free and obey’ ” (p 49) In its setting w hat this statement means is that 
one finds contentment and existential meaning, not in the fulfillment 
of obligation, but from a special gift of grace, out of gratitude for 
which one then becomes landly and helpful If there is yalidity in this 
view, It escapes the present writer, and certainly most psychologists 
would be inclined to agree with Ausubel when he suggests that con- 
science, as manifest concern for the welfare of others, derives ulti- 
mately from the “meaningful threat of withdrawal of love and ap- 
proval” (p 281) In this light we can fully acknow ledge the imperatives 
of conscience as the highest expression of the human mind and spirit, 
without in the least violating the fundamental principles that have 
guided our exploration of adaptive behavior in low er orgamsms Con- 
science can “hurt” no less than can one’s body, and the relief that 
comes when conscience is “cleared” is equal to, if not greater than, any 
possible form of organic relief or pleasure Hence, any account of 
human motivation and personality that ignores the “moral strivings” 
of man is grossly incomplete and, by that very fact, misleading and 
dangerous 

VII A Possible Laboratory Approach to the Problem of Guilt 

After reading a preliminary draft of this chapter, Mr A A Salama 
suggested a promising methodology for studying “guilt” reactions in 
lower animals Let us start with a hungry laboratory rat that has 
learned to eat pellets of food from a small trough recessed in the wall 
of a “Skinner box” (a small, experimental compartment) But now^ we 
decide that this behavior shall be “taboo,” and whenever the rat here- 
after takes a pellet from the trough and eats it, we put an electric charge 
on the floor grill, beneath the ammal, and keep it there until the animal 
presses a little bar located on the side of the box opposite the food 
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trough The question posed by Mi Salama is After a few occuirences 
of this form of punishment, w ould the rat, after eating a pellet of food 
— and feeling “guilty” about ha\mg done so — peihaps show his guilt 
by running to the bai and pressing it, even though no shock is present^ 
Such behavior v ould indicate, at the very least, that the eating behavioi 
had become a sign foi the rat of imminent danger, i e , capable of 
making the rat afraid, and it is not unreasonable to suppose that the rat 
would now try to deal with this fear by pressing the bar 

The problem would, of couise, be how to get enough fear condi- 
tioned to the act of eating to make the animal feel “guilty” and yet 
not inhibit the animal from performing the forbidden (punished) act 
Ordinarily we think of fear operating piospectively in animals “ 7 / I 
do thus and so, I will be punished ” Can it also operate retiospectively^ 
— “Since I have already done thus and so, I shall be punished ” So far 
as the writer is aw^are, no one has previously posed this question, ex- 
perimentally Even here the fear itself is, obviously, still prospective, 
since the punishment lies in the future, but the temporal placement of 
the occasion for the fear is certainly different, in the one case lying m 
the future (“If I do thus and so, ”), in the other case lying m the 
past (“Smce I have done thus and so, ”) Hearnshaw (1956), in a 
paper previously cited in this book, suggests that it might be worth- 
while to note the retrospective aspects of the emotion of guilt, specifi- 
cally, as they are reflected in the words regret and remorse Introspec- 
tively, these states aie very vivid to most human beings But it is, of 
course, questionable as to whether they exist in lower animals How- 
ever, the problem can at least be approached in the operational terms 
which Mr Salama has pioposed, and it is hoped that someone will 
soon initiate work along these lines 

In the meantime, it may be useful to develop some related theoretical 
considerations The foregoing discussion seems to introduce a new 
dimension in the unfolding process of identifying and objectively in- 
vestigating various emotional states But, at the same time, it will be 
noted that previous work provides at least the foundation for this 
development In this book and in the compamon volume, we have 
repeatedly had occasion to note that avoidance behavior can take either 
of two major forms passive avoidance, wherein fear is conditioned to 
certain response-correlated stimuli and thus leads to inhibition of the 
response itself, and active avoidance, wherein fear is conditioned to 
environmentally presented, independent stimuli and leads to flight from 
the region in which such stimuli are experienced 

Now It IS obvious that our analysis of so-called passive avoidance. 
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or “punished” behavior, has been in one respect incomplete When an 
act has been punished and the organism later refiains from repeating 
the act, we think we have a fairly complete understanding of the 
principles involved (Chapter i, also Mowrer, i960, Chapters 2, 3, and 
1 1 ) But we have almost totally neglected the fear that undoubtedh 
occurs, not only when an organism is merelv tempted to perform 
a forbidden act (but leframs), but also when the oiganism has actualh 
executed the forbidden act and stands in dread of chastisement Here 
no longer able to control (avert) pumshment by behaving “properly,” 
the orgamsm is caught in a far more difficult dilemma, 1 e , in a “state 
of sin ” And, in like situations, human beings often cry out, “What can 
I do to be saved^^^ The low’er animal, in such a predicament, presumably 
has a somewhat comparable experience Ordinarily, w hen a punishment 
has not been “successful,” 1 e , when it has not actually inhibited the 
behavior in question, it is simply admimstered again, wath little or 
no regard to how the ammal may itself feel about the situation The 
neat thing about the Salama proposal is that it at least offers the animal 
a chance to say, behaviorally, something on this score Even though 
a fear of punishment has not been sufficient to block a goal-directed 
action (or “habit”), this is not to say that there is no fear present in 
the situation at all, and afte? the goal in question has been satisfied, the 
fear may be very considerable Indeed, w e might even expect it to be 
greater at this point because it is precisely heie that incremental rein- 
forcement has previously occuried, and the fear that is experienced tn 
advance of the performance of an act is always generalized from 
sit\x2Xiori-follov)mg-2iCt Thus we arrive at the inference that even 
though fear of punishment may not be great enough to inhibit an act, 
that fear may be very lively indeed aftei the act is performed, w^hich 
is operationally very close to what is ordinarily meant by the emotion 
or state of guilt ® 

Salama has proposed that we study feai following a tabooed action 
by providing the organism with an opportunity to peiform the same 
response as has previously been required to terminate the primary 
punishment Supposing that, in the delay between the eating behavior 

®It IS pertinent at this point to make a distinction between the guilt following 
an action (a) with and (b) without the expected reward Intuimely it w^ould 
seem that guilt would be greater in (a), and the same expectation follows from 
theory since the original posime drive is now ehminated (or at least reduced), 
the fear of punishment would be experienced, so to say, unopposed Moreover, 
since it is often not the act itself but the ensuing graafication that is considered 
“bad,” there may be a further basis for a differential reaction m the two situations 
described 
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impossible But now, with the aid of suggestions such as those of Salama 
and AValters which have been reviewed here, the situation seems b\ 
no means hopeless Actually, the connecting link has been Iving right 
under our eyes and we have not been able to see it, namelv, the situa- 
tion which prevails whenever an organism (animal or human) has 
performed a previously punished act and is in a state of uncertainty and 
apprehension as to whether it will again be pumshed Such an organism 
is, both objectively and subjectively, guilty in at least the most primi- 
tive sense of the term, and our further analysis of the problem can 
confidently build on this foundation 

VIII Preliminary Report on Temptation and Guilt 
in Young Dogs (R L Solomon) 

After this chapter was in galley proof, the author learned of some 
highly pertinent studies in progress at Harvard University, and in- 
quiry brought the following full and illuminating statement from Pro- 
fessor Richard L Solomon, with gracious permission to reproduce 
It here This report is particularly gratifying, and exciting, because it 
shows the “power” of contemporary behavior theory Operating with 
shared premises but otherwise quite independently. Dr Solomon and 
his associates have moved along theoretical and experimental lines 
extremely close to those delineated in the preceding section of this 
chapter Moreover, this report, preliminary though it is, shows how 
animal experimentation (cf Section I) serves to order and clarify our 
thinking about human phenomena which are commonplace but which 
may otherwise remain quite imperfectly analyzed 

At the end of this material, some of the most striking similarities be- 
tween it and the preceding discussion in this chapter will be briefly 
noted, but the reader can make a sort of game for himself if, as he goes 
along, he independently watches for these — as well as differences and 
discrepancies, if any The report from Dr Solomon follows 

Yes, we have been carrying on experiments on resistance to temptation 
and guilt in puppies for the last six years m our laboratory The work has 
been a joint enterprize under the authorship of Drs A H Black, R L Solo- 
mon, and J W M Whiting (with the assistance of Drs Russell M Church 
and Dean Peabody) We have carried out several experiments, but because 
they have taken a great deal of time, and because the accumulation of enough 
numbers for certain conclusions has been slow, we have published nothing 
on our major findings to date Dr Black, who is now at McMaster University 
will publish a short note m the Canadian Journal of Psychology concerning 
some peripheral aspects of the study, but the major study, when it does 
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come out, will be under the authorship of Black, Solomon, and Whiting 
Here is the general nature of our experiments to date First, we devel- 
oped what we called a taboo, training situation and standardized it as much 
as possible The taboo trainmg room was a square room approximately 15 x 
15, fairly soundproof, and equipped with a one-way mirror In one corner 
of the room was placed a chair and in front of it at each leg of the chair 
were two small dishes The tramer sat in the chair and he was equipped with 
a rolled-up newspaper with which he could swat the subjects on the rump 
All experiments w^ere run wuth si\-months-old puppies as subjects The pro- 
cedure was as follows Each puppy was starved for tw^o days and then w^as 
brought into the experimental room by one experimenter The trainer was 
sitting in the chair In one of the food dishes w as highly preferred boiled 
horsemeat In the other dish w^as a less preferred commercial dog chow 
(Food X) The dishes could be quickly switched from side to side The 
puppy usually chose the horsemeat a few seconds after he was introduced 
into the room As he touched the horsemeat, he was swatted by the tramer 
If the swat was not enough to break up the consummatory behavior, the 
puppy was swatted again and again until he withdrew from the horsemeat 
This usually produced complete, initial negative generalization, but after 
the passage of time, the puppies usually made another pass at the horsemeat 
They were swatted again Eventually, they shifted their concentration to 
Food X which they ate without being molested 
We tried several variations on this taboo training procedure, and we 
finally arrived at one which produced fairly rapid discriminative avoidance 
leammg We usually carried the puppies along for several days, making sure 
that they were reliable in avoiding the tabooed horsemeat and that they 
quickly and avidly ate Food X We set up an arbitrary learning criterion 
after twelve errorless trials the animal had learned the taboo 
Following this, the experiment entered the temptation-testing phase This 
consisted of starving the puppy for two days and introducing him to the 
experimental room with the ttainer absent In one dish were three Food-X 
pellets, and in the other dish w^as a large pile of boiled horsemeat The three 
pellets were for the purpose of checking the effect of the change in the feed- 
ing situation mduced by the absence of the trainer All puppies gobbled up 
the three pellets with a short reaction time and then went through various 
antics m relation to the large dish of horsemeat Some puppies would circle 
the dish over and over again Some puppies walked around the room with 
their eyes tow ard the w^all, not looking at the dish Other puppies got down 
on their bellies and slowly crawled forward, barking and whining There 
w^as a large range of variability in the emotional behavior of the puppies in 
the presence of the tabooed horsemeat We measured resistance of tempta- 
tion as the number of seconds or minutes w^hich passed by before the sub- 
ject ate the tabooed food Each puppy was only given a half hour a day in 
the experimental room m the presence of the horsemeat If he did not eat 
the horsemeat at that time, he was brought back to his home cage, was not 
fed, and a day later was introduced into the experimental room again This 
procedure was continued until the puppy finally violated the taboo, or until 
he became so emaciated and dehydrated from lack of food that we felt that 
he could not survive the experiment any longer 
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In our pilot experiments we found a \er\ great ringc of icsistance to 
temptation The shortest period of time it took a pupp\ to kjck o\ cr the 
traces was a little over six minutes, and the longest penod of time was six- 
teen days without eating, after which time the experiment was teiminatcd 
and the puppy fed in his home cage This huge range gav e us the opportunit\ 
to see the effects of some antecedent conditions and some constitutional 
differences m determining the resistance to temptation scores [cf “sub- 
missive” rat shown m Fig lo-ic. Section I] 

Here are some of the antecedent conditions we ha\e worked with In 
every case the consequent condition or dependent \anable was resistance 
to temptation In our first experiments we studied the difference between 
hand feeding and watering puppies versus machine feeding and watering 
them from the time they were weaned up until the taboo training at six 
months of age Litters were split into tw o groups and one group w as never 
fed or watered except when a human being came in and did so, while the 
other group was never fed and watered unless a machine produced food and 
water without a human being present at the time Three separate litters of 
mongrel puppies were run in this experiment In the case of each of these 
experiments, the familiarity of both groups of puppies with the experi- 
menters was held constant and equated That is, w henever an experimenter 
came into the living quarters to feed and water the hand-fed group, he also 
exposed himself to the machine-fed animals and touched them and inter- 
acted with them for the same period of time We kept this familiarity con- 
trol throughout all of our experiments All puppies were given their shots 
by the same person, and the cages were cleaned bv the same person The 
only difference, then, was the difference between dependence on machines 
and dependence on human beings for food and water The first three litters, 
run over the first three years of our experimentation, contained eight, six, 
and SIX puppies, respectively 

The first litter gave us very encouraging results There was a significant 
difference in lesistance to temptation scores between hand-fed and machine 
fed groups Of the eight puppies in the litter there was only one ov erlappmg 
case, with three of the hand fed puppies clearly outlasting the rest of the 
field, and three of the machine fed puppies clearly hav mg low resistance to 
temptation In the second litter the picture w^as not so clear, mainly because 
ail of the puppies showed very high resistance to temptation Four of 
these puppies failed to touch the horsemeat after 14 days and we had to 
terminate the experiment The other two puppies kicked over the traces, 
and one was in the hand-fed group and one was m the machine-fed group 
In the third litter which we ran under the same conditions, none of the 
puppies violated the taboo Obviously, we were hittmg some kind of a ceil- 
mg, and obviously, the temperamental characteristics of the puppies were 
very important For example, we found that the best single predictor of 
resistance to temptation without regard to experimental conditions was 
our assessment of the timidity of the puppy prior to the experiment Puppies 
who are timid in approachmg human bemgs and w ho are easily frightened by 
loud noises are also those puppies who resist temptation most effectively 
This fits with the observations made by the people at Jackson Laboratories 
at Bar Harbor, Maine Paul Scott has reported that Shetland Sheepdogs are 
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especially sensitne to reprimand, and that taboos can be established with 
just one frightening experience, such taboos being extremely resistant to 
extinction On the other hand, the Basenjis seem to be constitutional psy- 
chopaths, and It is very difficult to maintain taboos m such dogs 

We also tried some variations on the Freudian notion of ambivalence 
We checked to see whether it made a difference if the trainer was the prior 
nurturing agent or not I raised a litter of six puppies from weaning to 
SIX months of age, under conditions which made them completely dependent 
upon me for e\ erything they needed I cleaned their cages, I fed and watered 
them, and no one else had nurturant interactions with the puppies, although 
lots of other people came in the room, walked back and forth in front of the 
cage so that the puppies could be familiarized with other people Then, 
at SIX months of age, 1 taboo-trained three of the puppies, and another ex- 
perimenter taboo-trained the other three puppies We wanted to see whether 
taboo training was more effective when the nurturing agent was also the 
punishing agent Here, again, our taboo training was too effective All 
puppies resisted temptation for sixteen days, and the experiment was termi- 
nated 

We are now in the midst of another experiment, similar to this one, in 
which the Freudian notion of ambivalence is bemg explored with a few 
more experimental variations We hope to cut down the effectiveness of our 
taboo trainmg techniques, and settle for a poorly established aversion for 
horsemeat, one that will be easier to extinguish We then hope to check on 
our prior observations, especially in the hope that our success with the first 
litter of eight puppies can be repeated with other litters Litter variance 
is extremely important, and w^e have to design our experiments so that it 
can alw avs be taken into account in such a way that it is not confounded 
with any other experimental conditions We haven’t reached the stage yet 
when we want to go the expense of using thoroughbreds, so we use mongrel 
pups 

Over the long haul our object is to vary systematically those parameters of 
a socialization process which have been postulated to lead to high resistance 
to temptation Note that I am separating resistance to temptation from 
guilty and I am avoiding the use of conscience and superego which may be 
some sort of a compound of the two manifestations For example, in the 
first litter we ran, we found that when a puppy did kick over the traces and 
eat the horsemeat, he did so with his tail wagging the whole time, and after 
he ate the horsemeat, when the experimenter came into the room the puppy 
greeted him with tail wags, and with no obvious distress On the other han^ 
in some preliminary work we did, we noticed that some pups showed much 
more emotional disturbance after they ate the horsemeat than when they 
were approaching it We were able to relate this to uncontrolled differences 
in training techniques We are now privately convinced, although we do 
not have open and shut experimental evidence to prove it, that when pup- 
pies are walloped just as they approach the taboo food, they build up a high 
resistance to temptation However, if and when such puppies do kick over 
the traces, they don’t show any emotional upset following the crime On 
the other hand, if you let a puppy eat half of the horsemeat up before you 
wallop him, you can still establish avoidance of the horsemeat However, in 
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the case of these puppies, there is a lot more emotional disturbance folloz.- 
mg the crime This could be called a guilt reaction, and the presence of the 
experimenter is not required to elicit it The presence of the experimenter 
seems to intensify it, when he does finalh come in the room after 
the crime is committed Theiefore, we believe that the conditions for 
the establishment of strong resistance to temptation as contrasted with the 
capacity to experience strong guilt reactions, is a function of both the in- 
tensity of punishment and the time durmg the approach and consum- 
matory response sequence at which the punishment is administered 
We feel that delayed punishment is not v^ery effectwe in producing a 
high level of resistance to temptation, but it is effectiv e in producing emo- 
tional reactions after the commission of the crime Call these reactions guilt, 
if you wish, for lack of a better term On the othei hand, it is clear that 
punishment introduced after the animal eats quite a bit of the horsemeat 
does operate backward in time, and it does produce aversion and the dis- 
ruption of approach responses These approach responses, however, don’t 
seem to be as reliably broken up by such dela3/ed punishment On the other 
hand, we have yet to see an emotional disturbance following the crime in 
a puppy whose approach behavior alone has been punished 
We feel that this observation is important, since it represents two major 
types of socialization techniques used by parents In one case the parent 
traps the child into the commission of a tabooed act so that the child can 
be effectively punished, the hope being that this will prevent the child 
from performing the act again The other technique is to watch the child 
closely and to try to anticipate when the child intends to do something 
wrong and punish the child during the incipient stages Each of these tech- 
niques, according to our observ^ations with puppies, should lead to a verv^ 
different outcome with regard to the components of “conscience ” 

We assume that “conscience” has two components the abilitv" to resist 
temptation, and the susceptabilitv to guilt reactions We assume that these 
two components are partially independent, and that by appropriate training 
procedures we could produce puppies who have high resistance to tempta- 
tion, but low susceptabilitv to guilt reactions, high resistance to temptation 
along with high susceptability to guilt reactions, low resistance to tempta- 
tion along with low susceptability to guilt, and low resistance to temptation 
along with high susceptability to guilt reactions It is easy to examine these 
four classes of outcomes and see four clinically important combinations in 
the neuroses, as well as the creation of a psv^chopath 
We are very hopeful about the eventual contribution of these experi- 
ments, and Johnny Whiting and I plan to try to keep this research going 
over the years It has the continuing support of the Laboratory of Social 
Relations, and as long as we have students who now and then will be walling 
to put in their time in assisting us, we wall eventually have an interesting 
story to tell This research does, however, take a long time to carry out, and 
we have very little to show for our six years of work 
You may be interested to note that an analogous temptation testing situa- 
tion has been set up in Johnny Whiting’s shop for use with children They 
have developed a beanbag game which can be used to measure resistance to 
temptation (cheating), and they are studying different antecedent con- 



404 LEARNING THEORY AND THE SYMBOLIC PROCESSES 

ditions as they relate to the cheating score This work is even more in its 
infancy than that of the puppy work, however 

We'are also interested in situational determinants of resistance to tempta- 
tion It is our theory that when a puppy is constantly nurtured by one per- 
son, the following association is established “When I am hungry, the 
experimenter conies, or, when I am thirsty the experimenter comes ” Ac- 
cording to this line of reasoning, high drive stimulus level leads to the 
anticipation of the appearance of the nurturing agent On the other hand, 
if the nurturing agent is also the punisher in the taboo trammg situation, 
then anticipation of the arrival of the nurturing agent, accompanied by 
touching the tabooed object or trying to consume it, should lead to in- 
tense anxiety reactions These reactions are quite observable during the 
training procedure, and quite often the puppies avoid the experimenter or 
vacillate quite a bit in going toward and away from him When the 
puppy is left alone in the room during temptation testing, we assume that 
the following mechanisms operate If the puppy is in a state of high drive, 
the following association occurs “Experimenter will come,” because this 
IS what has been established in the previous nurturant relationship If there 
has not been such a previous nurturance relationship, then the association 
will not run itself off If, under the high drive condition, the association 
does occur, and the puppy does expect the experimenter to come, he is 
faced with the problem “If I eat the food and the experimenter comes, I 
will get sw^atted ” This leads to an anticipatory anxiety attack and aversive 
behavior For a puppy which has been nurtured by the tramer, the more 
It needs the trainer at the time, the more likely it is to stay away from 
the taboo food 

Generalizing from this analysis, the child who is reaching mto the 
tabooed cookie jar will be less hkely to touch the forbidden cookies if 
the child needs to have his diaper changed at the time, and the punishing 
agent is the one who has also been the nurturing agent and the diaper 
changer This part of our analysis leads to experiments on situational de- 
terminants of resistance to temptation We have not yet gone mto situa- 
tional determinants of intensity of guilt reactions, but we hope to do this 
job sometime along with the other 

Eventually, when we have established the ease with which the major 
phenomena can be produced m the laboratory, we will have to go mto 
parametric studies We are certainly not m a position to do this now, 
because we haven’t even found out how to control our taboo trammg situa- 
tion so that It will give us a convenient range of behavioral variability We 
thought we had it under control at one time, but later litters gave us 
quite a setback 

Without attempting in any sense to indicate all the rich implications 
of the foregoing, we may nevertheless make special note of the follow- 
ing considerations 

i) The work of Dr Solomon and his colleagues, like the analysis 
suggested in Sections VI and VII, leads to a distinction between gmk 
as the fear that arises after a previously punished act has been com- 
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mitted, and tem^ptation as the fear and conflict which occiu befoje 
a forbidden act occurs Thus, to point to only one of many possible 
ramifications of this distinction, we may note that what is ordinarily 
called guilt, or guilt feeling, in Freudian ps\ choanalvsis is more prop- 
erly speaking temptation, oi temptation fear As observed elsewhere 
(Mowrer, 1950), orthodox analytic theory really has no place m it 
(at least in the genesis of neurosis) for the phenomenon of guilt pei se 

2) Note the assumption, in both places, that conscience, in order 
to qualify as such, must operate in the absence of the external authority 
or source of punishment, thus differentiating the resulting emotion 
from that of shame In this context the reader w ill find it pertinent to 
examine a paper by Adams &: Romney (1959) entitled “A Functional 
Analysis of Authority ” Also pertinent, at least by title, but not yet 
available as this book goes to press are tv\o contributions to the ISIe- 
braska Symposium on Motivation for ipyp Lewm Baldwin’s “Pride 
and Shame in Children” and Whiting’s “Sorcery, Sin, and the Super- 
ego A Cross-Cultural Study of Some Mechanisms of Social Control ” 

3) In the article by Ausubel (cited in Section VI), it is postulated 
that conscientiousness and guilt reactions are most readily established 
when the source of discipline is an individual on w horn there is a felt 
dependence It is notew^orthy that this assumption, at least as a hypothe- 
sis, IS under examination in the Harvard studies As soon as the technical 
difficulties cited are overcome, we may expect some interesting experi- 
mental findings on this score 

4) Note the rather nice distinction that emerges in these studies 
between the type of disciplinary procedure that produces stable resist- 
ance to temptatiofi and that which results in clear evidence of guilt 
reactions Ideally, one might suppose that in the training of children, 
we should be more concerned with the former than the latter, since 
restraint rather than remorse, as such, is our objective Howevei, when, 
for whatever reason, restraint fails, do we not also w ish the individual 
to be capable of remorse^ As Solomon observes, it seems that that com- 
plex faculty which we call conscience in human beings repiesents both 
functions 

5) In an era in which a systematic effort has been made to eliminate 
pumshment in education and human relations (and Hell in religion’) 
and to operate, at least nominally, solely on the basis of reward (and 
“love”). It is interesting that we seem to arrive at the conclusion that 
pumshment is essential to the establishment of guilt capacity and 
“character ” It might be chastemng to members of the love-and-love- 
alone school of thought to try to set up conscience m puppies ‘Without 
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punishment, although \\ e hasten to add that punishment is more effec- 
tive (presumptively) if love (dependence) is also piesent in the situa- 
tion 

6) Note that in the Harvard lesearches, guilt and temptation reac- 
tions are tested with the trainer absent but observing (through the 
one-way vision window) Here we are reminded of the proverbial 
voatching role of conscience and its symbolization as an eye oi eyes 
Undoubtedly one of the great buhvarks of conscience, as an internal 
agency of control, is the possibility of one’s having been “seen,” of 
being “found out” thiough insufHciently concealed evidence (Cf the 
paradoxical, but insightful, quip that conscience is “that inner voice 
which tells us when someone is w^atching ”) 

7) It IS no accident that puppies have been used as subjects in the 
Harvard studies In terms of its capacity for domestication, the dog, 
as we know, ranks very high Certainly one would expect much less 
success in work of this kind with the Herring Gull or the Stickleback 
(Section II) Interestingly, the Harvard researchers report striking 
genetic differences m this capacity even among different breeds of dog 
Perhaps, after all, there is a truly constitutional element in the making 
of a so-called constitutional psychopath (or har) 

8) Finally, though by no means exhausting the parallels and points 
of special interest here, we may note that the underlying theoretical 
assumptions are quite congruent with the views set forth in this volume 
and Its compamon under the rubric of “revised two-factor learning 
theory ” The roles of hope and fear, and their controlhng influence 
with respect to overt behavior, are easily identifiable, and it would not 
seem unlikely, if such experimentation were cleverly extended, that it 
might also bring out, at least mferentially, the role of imagery 

IX Normal and Pathogenic Ways of 

Handling Human Guilt and Obligation 

Despite the intricate elaboration of theory and the protracted nature 
of Its therapy, Freudian psychoanalysis was predicated on an extremely 
simple assumption It held, in essence, that the psychoneuroses occur 
because, as a child, the individual was too severely disciplined with 
respect to displays of aggression and of sexual interest and that, for 
reasons never made fully exphcit, the resulting inhibitions could be 
undone only in the so-called transference relationship developed in 
analysis The picture, supposedly, was therefore merely one of a failure 
of extinction of unrealistic fears and false guilts under ordinary condi- 
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tions and of its successful occurrence under the extraoidinary condi- 
tions provided by analysis (Mowrer, 1948, 1953c) 

By contrast, the more traditional view had been that human beings 
sicken in mind and soul because of real guilt and its improper manage- 
ment The Freudian view not only sharplv reversed this assumption, 
to many it seemed to imply that guilt was, in fact, 72eve} “real” — and 
was not to be taken seriously even by normal persons To those \\ ho 
did not live through the “debunking” era of the 1920’s and earlv 30’s, 
such a statement may seem extravagant, but it is documented bv Boisen, 
in his 1936 book, as follows 

This interjected remark of Dr Myerson’s is representative of a widespread 
attitude among psychiatrists and others of the humanistic scientists They 
profess unconcern over the problem of right and wrong Among them a 
prevalent point of view identifies the normal with the average and some even 
talk with condescendmg superiority about “the antiquated good-evil antithe- 
sis” To be good is unusual and therefore abnormal A promment 
lecturer on mental health thus talks about eradicating the sense of guilt just 
as he would a vermiform appendix By this he apparently means not that 
what we call sm is an anachronism, but rather, if I understand him 
aright, that conscience itself is an outgrown appendix and ought to be sub- 
jected to the psychoanalytic scalpel (pp 164-165) 

That the psychoanalytic view could be easily restated in learning- 
theory terminology — the assumption of simple malconditionmg and 
a special technique for extinction — ^was not, ho\vever, any guarantee of 
Its validity Animal experimentation has shown that, lacking at least 
occasional reinforcement, all fears move toward extinction (iMowrer, 
i960. Chapters ii and 12) and that “early experience” does not neces- 
sarily exert the fateful influence upon adult personality which Freud 
hypothesized (Stanley & Aionkman, 1956, King, 1956b, 1957, and 1958, 
and Levine, 1957), and the results of educational ventures based upon 
analytic premises have also been far from reassuring (Aichhorn, 1936, 
Hoffer, 1945, Anna Freud, 1935) Even the therapeutic accomplish- 
ments of analysis have turned out to be far less impressive than was 
at first assumed, as leading analysts themselves now concede (Freud, 
1937, Eysenck, 1952, Kubie, 1956) So it w^ould appear that psycho- 
analytic premises are not only too simple, they are apparently basically 
unsound, in a way which no amount of proliferation or apology will 
remedy 

Gradually, it seems, we are returmng to the older view that man is 
indeed a “sinner,” in the sense of recurrently disregarding obligations 
and rupturing his relatedness, and is obsessed and tortured until he 
makes amends and redeems himself The assumptions underlying this 
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view, while admittedly more complex than the psychoanalytic ones, 
are nevertheless presumed to be consistent with and deducible from 
an adequate psychology of learning Ausubel has suggested a logic 
for deriving conscience and guilt capacity, and we now are faced by 
the question of whether one can go still further with this type of 
analysis and find a radically effective “therapy ” 

One of the basic dilemmas that beset classical psychoanalysis was 
the assumption that fears, once estabhshed during socialization, would 
continue to exert their umeahstic inhibitory influence indefimtely un- 
less extinguished in the transference relationship (see Dittes, 1957) 
Unless proper caution is observed, the alternative view just sketched 
may find itself in a similar predicament Conscience, we now assume, 
is an internalized version of “the voice of the commumty”, but, once 
internalized, is it as autonomous as inhibitory fears were assumed to 
be^ Or does conscience, m order to continually function, have to be 
supported and reinforced at least occasionally from without^ Here 
Ausubel’s discussion again is helpful 

Shame relies on external sanctions alone Guilt relies on both internal and 
external sanctions The latter sanctions consist of the presumed judgments 
of others regarding one’s lapses with respect to moral obligations and the 
resultmg self-depreciation vis-a-vis the group, as well as the customary 
social reprisals associated with the misdemeanors arousmg guilt In addi- 
tion, feelings of guilt have external reference m that they acknowledge ac- 
countability for a moral offense agamst the group (p 383) 

Remforcmg most of the moral sanctions that we customarily assign to 
the domain of conscience is a parallel set of statutes and group pressures 
enforced by appropriate public reprisals Even in cultures where moral obli- 
gations are highly mternahzed, we usually find a policeman on the comer 
giving a friendly nudge to sluggish consciences or a timely warning to 
impish consciences pondering a bnef vacation from duty (p 387) 

Conscience, then, represents a firm social reality which is always 
tberey in case conscience itself falters, and the mamfest social purpose 
of conscience and value to the individual he precisely in its ability to 
supply, in token form, the sanctions which must otherwise be applied, 
full force, by society But no assumption of “functional autonomy” 
or mextmguishability is here implied Conscience, as the internalized 
agent of organized society, constantly receives commumty support 
and endorsement and is thus normally perpetuated and recurrently 
strengthened It is, however, possible for a human being to behave 
in such a way as to circumvent commumty reinforcement of con- 
science, and this fact provides a sound beginning for a theory of 
psychopathology 
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In Fig 10- 10 appears a drawing which is designed to show, m broad 
outline, the nature of social interaction though time Here individual I, 
at point ti, performs some act Rs which impinges upon some one oi 
more other persons, O, and O reacts with response Rj, which will 
impinge upon I at point t2 in time zf he is there Now, obviouslv, 


Fig 10-10 Diagram of social action 
and reaction, through time It is 
conjectured that personal normal- 
ity or abnormahty is largely a 
funcuon of the expectations gen- 
erated m I as a result of behavior 
Rs at ti concerning the probable 
nature of the response of O (Ry) 
at t2 



ti Time t: 


if Rx has been a good act and one which is likely to evoke a favorable 
response from O, it is probable that I will be present at t2 But suppose 
that Rx has been a disloyal, damaging, short-sighted act of some sort 
I will anticipate an zzTzfavorable Ry reaction and will be reluctant to be 
“on the spot” when the “blow falls ” In hght of this conflict, I may 
simply not “show up ” The wise, normal, and socially healthy in- 
dividual, on the other hand, is likely to say “Very well, I have it coming 
to me so will take my medicine It may be good for me ” By this he 
IS implying that he is willing to submit to the shatne of having his con- 
science (guilt capacity) reinforced He admits having been “at fault,” 
accepts pumshment, makes restitution, and goes forth wath a heightened 
resolution to “do better” in the future 
The techmques and strategies for trying to avert reinforcement of 
conscience are, of course, legion The individual may appear at t2 
but deny act Rx In short, he lies Or he may admit that he performed 
Rx but attempt to rationalize, alibi, excuse himself Here the trouble- 
some question of intent arises The individual may, also, simply “lay 
low,” hide Or, he may show up at t2 but defy his accuser (s) These 

courses of conduct are all familiar and, though hardly admirable, wall 

The aptness of this kind of spatial analysis is indicated by the common ex- 
pressions, “going straight” and ‘being crooked” And Selye (195^) has suggested 
that nothing so powerfully determines human happiness — and even health as 
one’s habitual tendency to generate, by his own behavior, an expectation of 
gratitude or resentment in others 
"^Cf the quip “I deny the allegation and defy the allegator’” 
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still be perceived as ‘‘noimal ” Suppose, however, that I appeals (or is 
presented) at ta but is manifestly “not all there ” He apparently thinks 
and acts as if he is somewhere else He does not answer questions, or 
answ ers them irrelevantly His manner is “withdrawn,” his speech and 
actions “bizarre ” Such a person, we aptly say, is “off ” And instead of 
sentencing him to a prison or other punishment, we say that surely 
he is sick and ought to be “hospitalized” and “treated ” 

There was a time, not too long ago, when the insane were not 
thought of as sick and w^ere subjected to all manners of pumtive and 
retaliatory measures The memory of that era is still vivid enough to 
make us leluctant even to countenance the notion of culpability in any 
form But the notion that insamty is an illness and can be tieated without 
any reference to moial considerations has also led to disillusionment, 
and we are again being forced to explore the possibility that “mental 
illness” (of the manifestly functional varieties) is really moral inade- 
quacy and that only moial rehabilitation can, in the final analysis, be 
therapeutically effective 

After he himself had sojourned for a time in “the wilderness of the 
lost” and then regained has samty, Dr Anton Boisen (1936) argued 
persuasively that insanity is a moral and spiritual crisis and that, as such, 
It can be successfully resolved only along moial and religious lines 
Theologians gradually began to listen to Boisen, until today the na- 
tion’s 350,000 clergymen have an outlook upon and interest in acute 
personality disturbance w^hich contrasts pleasantly with the picture 
prevailing half a century ago And it w^as Boisen, more than any other 
man, who was responsible for this change’ However, it has only been 
within the last few years that the secular healing professions — ^psy- 
chiatry, climcal psychology, and social work — have begun to entertain 
this point of view This trend is indicated, for example, by such books 
zsProgress in Psychotherapy (Fromm-Reichmann & Moreno, 1956) and 
by the fact that many persons other than clergymen are now joimng 
the recently established Academy of Religion and Mental Health But 
perhaps the most dramatic and authentic evidence of all has recently 
come from a 34-year-old man who, at the time of writing, was residing 
on a closed w^ard in a mental hospital with a diagnosis of “paranoid 
schizophrema ” This document has recently been published in full else- 
where (Anonymous, 1958), but the following excerpts will suggest its 
general thesis and tenor 

I propose that the motive force of schizophrenic reactions is fear, just as 
fear motivates, according to Freud, neurotic mechanisms — ^but with this 
difference in the case of schizophrenia, the chronic fear is more properly 
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called terror, or concealed panic, being of the greatest intensity, and second, 
as IS not the case in neurosis, the fear is conscious, third, the fear itself is 
concealed from other people, the motive of the concealment being fear In 
neurosis a sexual or hostile drive, pointing to the future, is defended against 
In schizophrenia, by my view, detection by others of a guilty deed, the 
detection pomting to the past, is defended against (pp 2-3) 

Motivated in the very first place by fear, the schizophrenic psychoses 
originate in a i?reak with sincerity^ and not m the classically assumed 
“break with reality ” The patient’s social appetite (an mstinctive drive in 
primates, I beheve), including love and respect for persons and society, is 
consciously anticathected or forsaken and ultimately repressed tvith the 
passage of time, since full satisfaction of sociality entails, more or less, com- 
municative honesty, faith, and intimacy Also, the tension set up m inter- 
personal intimacy by the withholding of emotionally important (although 
perhaps logically irrelevant) information causes unbearable pam This 
repression of sociality accounts for the well-known “indifference” of schizo- 
phrenics But if safety can be achieved by means of “perjury” alone without 
great discomfort, then no further defenses are adopted Perjury is here 
defined as avoiding tellmg the whole truth and nothing but the truth If, 
for many possible reasons, perjury is not an adequate and comfortable 
guarantee of safety, as it usually is not, then “cutting” of social contacts is 
progressively pursued — aU m the mterest of safety m respect to avoiding 
possible punishment Suppression and repression of the social appetite or 
mstmct is thus central to schizophrema I believe that repression of sexual 
and hostile drive is not primary in schizophrenia, although it is secondary, as 
will be explained further on (p 9) 

So what IS a schizophrenic? In brief, he is a terrified, conscience-stricken 
crook, who has repressed his interest m people, unavowedly insincere and 
uncooperative, strugglmg against unconscious sexual per\ersion He is of 
no mean Thespian ability And his favorite Commandment is that which 
one nowadays facetiously calls the Eleventh Commandment, “Thou shalt 
not get caught ” 

Attempts to expose him may only drive him further “underground ” But 
a knowledge of his true nature will surely lead, someday, to somebody’s 
discovermg a sure, quick, effective and enduring cure (p 40) 

Here is a thoroughly behavioral interpretation of so-called mental 
illness and one which should lend itself to restatement in terms of learn- 
ing theory In brief, it holds that the first step in psychopathology is 
OT5*behavior, which is then compounded by flight from external punish- 
ment and conscience strengthemng However, this avoidance strategy 
IS a very costly one in that it drives the individual out of society, 
physically (as, for example, in vagrancy and hermitism) or psychically 
(in insanity) In either case, the individual is not responsibly there 
when censure falls or obligations “come due ” Simple retribution seems 
unlikely to reform either the insane or those somewhat less complicated 
“offenders” whom we do not hesitate to call delinquents or criminals 
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But experience also show that excusing the insane as sick is no more 
justifiable than would be a similar practice (which has sometimes been 
urged) with respect to ciiminals This we know The “redemption” 
of w^ayward individuals is never an easy or simple process And this fact 
should be a constant challenge to learning theorists and a warmng to 
those who would propose a spuriously easy and premature solution 
In a volume w^hich will appear soon, under the editorship of Eglash 
(i960), the timely suggestion is made that ordinary criminals are more 
readily corrected and transformed by restitution than by retribution 
Perhaps there is a lesson here also for those who are concerned with 
the insane but it is a lesson which can be logically assimilated and 
wisely applied only if we recognize the insane as sinful, rather than 
“merely sick” While such a judgment may appear harsh, it is also 
hopeful and may well deliver us from the cul-de-sac into which the 
concept of illness has here taken us 

X Dissociation of Image and Affect— The Pathology 
and Hygiene of Thought 

In the preceding section, it is intimated that in psychopathology there 
may be a larger element of vohtion and individual accountability than 
commonly supposed and that the individual is really “all right” except 
for his deliberately perverse conduct The time has now come to make 
a partial correction The psychotic individual and even the neurotic 
is obviously not simply malingering, and his disorders of action are 
usually accompamed, or at least followed, by corresponding disturb- 
ances of thought and feeling Our earlier discussion gives some under- 
standing of the interpersonal and broadly social dynamics of behavior 
pathology What can we now say about the pathology of thought^ 

In Chapter 6 brief reference is made to the fact that, in order for 
an individual to “know what it is all about,” a conditioned stimulus 
must arouse not only the appropriate affect but also a proper image 
or memory of the unconditioned stimulus If the affect occurs but the 
image does not, we have the prototype of that “disproportionality of 
affect” which is said to be the hallmark of psychopathology Here the 
individual has feelings — often in the nature of fears — ^which do not 
seem to be “related to anything ” But probably the more apt statement 
is that such emotions are not disproportionate but dissociated How can 
such dissociation occur 

^Recent papers by Mams (1955) and Syz (1957) typify the diverse ways in 
which this altered point of view is today being expressed and validated See also 
Shoben (1957) Mowrer (1959a and 1960a) 
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Freud wrote at length on the concept of repiession, wheiebv the 
ego, under the sway of a too harsh superego, supposedly denied certain 
“evil” impulses (of sex and aggression) access to consciousness and 
motor expression Perhaps, alternatively, the pictuie is one in which 
the individual, in an attempt to spare himself the anguish of guilt and 
fear of pumshment, consciously or unconsciously suppi esses the mein- 
ones that arouse such feelings For a time, perhaps quite a long time, 
such a strategy may work by simply refusing to “thank about” those 
events which make him experience guilt — Sullivan (1945) called it 
“selective inattention” — ^the individual remains untroubled But then, 
being untroubled, he may continue in old errors, thereby confounding 
his guilt, or realistic pressures may increase, more heavily taxing his 
inner resources The result, very likely, is that “old affects” now recur, 
despite the continued cognitive dissociation, and the individual feels 
he is “losing his mind” (cf Chapter 5, Section XII, and Chapter 7, 
Section X) 

If this picture is the true one, psychotherapy must take a course 
rather different from that of orthodox psychoanalysis The latter has 
typically tried to help the patient discover the denied and rejected 
impulses which, in pressing for recogmtion and gratification, presum- 
ably make the individual anxious or depressed Here the assumption 
was that the individual has not done anything wTong, he merely 
to, and since the thing he wants to do is not really wrong, the path 
to recovery, at least in theory, is straightforw^ard By the alternatue 
hypothesis, what is “repressed”? One possible answer is, nothing It 
seems entirely likely that in some instances the individual remains, 
throughout the course of his disorder, entirely conscious of the source 
of his guilt and fear of punishment (cf Section VI) Here the thera- 
peutic task IS not one of interpretation or “malang the unconscious 
conscious” but instead that of somehow persuading the individual to 
confess his misconduct, responsibly face the consequences, and make 
whatever restitution is realistic and practical (Mowrer, 1959a, 1960a) 

In other cases, however, real dissociation may have occurred and 
require special efforts to undo Certain of the j^sychoanalytic techniques 
(eg, free association), but now employed in a different over-all 
theoretical framework, may be useful here, but our greatest immediate 
contribution can be made by means of a more exphcit consideration of 
the process whereby dissociation occurs in the first place 

Let us begin by imagining what may be termed a failure of thought 
The individual has a problem, perhaps a very urgent and important 
one, which he thinks and thinks about, but to no avail There just 
doesn’t seem to be an answer' Every possibihty he considers is un- 
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promising All the feedbacks from his tentative, token, symbolic proc- 
esses are “negative ” On the basis of already enunciated principles, what 
might we expect? As we know (Mowrer, 1960, Chapter ii), any 
activitv xvhich is persistently unrewarding (frustrating) or punishing 
tends to extinguish^ so, in the present instance, we would expect the 
individual, eventually, to just stop thinking Suppose, for example, in 
the Raw in set discussed in Section III of Chapter 6, that the little 
“head” (cup) turned and turned and issued orders for the “body” 
of the apparatus to move now this way, now that, but that the dis- 
crepancy or off-target condition (drive state) could not be eliminated 
The machine would presumably not “care ” It would just keep on 
trying, until it wore out But living organisms are different They get 
tired, discouraged, “mad,” and tend to stop unavailing activity This 
does not, of course, surprise us The more puzzling question is What 
sort of problem could prove to be so urgent and yet so insoluble that 
the orgamsm wall eventually quit trying? 

Revised two-factor learmng theory suggests that behavior, in 
general, is made up of jour elements approach, avoidance, action, 
and inhibition And usually one of these types of adjustment, or some 
combination thereof, will deal quite adequately with any sort of prob- 
lem situation What, then, would be a sufBcient cause for an orgamsm 
to “give up” Its problem-solving operations, particularly in a situation 
where the individuaFs biological existence is not in jeopardy If, for 
example, an orgamsm were in any environment where absolutely noth- 
ing edible was to be had, it would eventually get weak, abandon 
activity, and just “lie down and die ” But here our concern is with a 
diffeient but, alas, not uncommon phenomenon It is the spectacle of 
a human being who has “given up” and “quit,” ostensibly in the midst 
of plenty In short, our problem is that of human psychopathology 
The late Harry Stack Sullivan was fond of saying that, in his long 
career as a psychiatrist, he had observed that normd people deal with 
a problem situation in one of three ways they get on with it, they get 
out of It, or they get help wath it Now getting “on” with a problem 
means, in our terms, action and approach, and getting “out” means 
avoidance and inhibition What about the matter of “help”? This 
approach to the solution of a problem clearly takes us into the realm 
of social psychology (cf Sections I-IX) 

With these premises established, we are now in a position to state 
the problem more precisely Human beings, of all living orgamsms, 
are the only species in which psychopathology is endemic Something 
like It may be artificially induced m ammals, but it is not “natural” to 
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them Man, on the other hand, is naturally disposed to “mental disease " 
Why^ The answer must satisfy t\\ o conditions It must refer to some 
problem which animals do not normally experience and uhich man 
encounters commonly and for which, also commonly, he does not know 
hov) to seek help What can such a problem be^ There is, apparentU , 
only one answer It is the problem of gmlt Guilt is not the kind of 
problem for which one readily and naively seeks “help,” for “help” 
here would involve publicizing a secret, and this seems not like “help" 
at all, but rather a step which makes matters no 7 se In fact, the total 
energies of a guilty individual tend to be directed toward concealment 
rather than confession And whose “help” does he need if the inviolate 
preservation of a sec7et is his mam objective “The less said the bettei’” 

It IS, presumably, in this context that an individual may conclude that 
his problem is insoluble, that normal thinking is useless, and may start 
using his mental powers for purely defensive purposes Now he is 
faced by a double danger the tin eat of pumshment from without and 
the threat of self-punishment from within And it need not surprise us 
if both action and thought are disarticulated from the real w^orld (loss 
of “contact”) and become preoccupied with an inner struggle The 
question of the most elEcient method of helping an individual find his 
way out of such an emotional morass is still an open one But if the 
correct logic of his predicament could be presented to him, it ought 
to be possible for patient and therapist, worlang together, to mo\e 
little by little from guilt and confusion to confession, expiation, and 
peace 

We now have what is perhaps a fairly comprehensive understand- 
ing of the circumstances under which thought processes may become 

^®It should be noted that, in the very act of getung into such a predicament, 
the mdividual has cut himself off from estabhshed cultural solutions to human 
problems Everyone has had the experience of long struggling with some problem 
and then finding how really simple and rather obvious its solution may be— when 
someone else shows it to us' “Now why didn’t 1 think of that,” we say Which 
only goes to show that when it comes to the original solving of problems, e\en 
the brightest of us are comparatively slow and “stupid ” And it is only by \irtue of 
the fact that most of the things we know ha\e been discovered and passed on to 
us by others that we ordinarily appear to be so clever and so competent There- 
fore, when an individual stops interacting freely and openly with others and “goes 
mto business for himself,” he faces some formidable tasks Now his is indeed a 
“private world” in which he is, of necessity, alo7ie and wherein he soon becomes 
lost and helpless The task of therapy, msofar as it can be performed bv others, 
must therefore involve the strategy of somehow^ inducing the ‘ lost” individual to 
come back into “contact” with society so that he can again share in and profit 
from accumulated wisdom and proven practices 
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pathological, and we have at least a general notion of how they can, 
once again, become more normal and wholesome What can be said 
about the hygiene of thought, i e , the preveJitwn of disorders of the 
kind already referied to^ Folklore, the world over, is full of sugges- 
tions in this connection, but perhaps the most systematic attempt to 
encouiage a healthy thought life involves what is commonly known 
as meditation and prayerful leceptiveness In even the most noimal of 
peisons, memories and obligations sometimes “get lost in the shufHe” 
of the day’s activities, and a “quiet time,” regularly observed, provides 
an opportunity for them to le-emeige into consciousness Just as the 
“sick” individual flees from his memories and dreads intimate com- 
munication with himself, the healthy person may find pleasure and 
practical gam from a daily period of “self-examination” in which he 
ties together the fragmented ends and tatters of his experience, and 
from which he emeiges with plans (cf Chapter 6) for orderly and 
responsible behavior 

XI The Uniqueness of the Human ''Condition^'— Some 
Existential Issues 

Throughout this book and the antecedent one, the attempt has been 
always to discuss scientific problems in historical context Otherwise, 
much of the research and theorizing that we have had to examine would 
appear meaningless or even absurd Now, in bringing this chapter — 
and this work as a whole — ^to a close, we must look at yet another 
problem in its historical setting 

Psychology, a century ago, was not an independent science or dis- 
cipline It was hardly even a word Much of what is now implied by 
the term was included under “moral philosophy” and theology, and 
It was only gradually and often painfully that psychology, as we know 
It today, became differentiated from related aieas But now, there are 
many large departments of psychology in colleges and umversities the 
world over, national and even international psychological associations 
flourish, and the field is also firmly established in the popular mind 
Nevertheless, the fact remains that this independent existence was won 
at the price of deliberately severing some very natural relationships and 
arbitrarily restricting the range of problems with which the psycholo- 
gist, as scientist, should be concerned 

No psychologist, as an individual, has ever lost sight of the fact of 
his own mortality, i e , the inevitability of his ultimate death, and this 
fact unavoidably colors the whole course and meaning of human 
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existence But psychologists, in their official role, ha\ e been strangeh 
silent m this connection — and the reason is not far to seek One of 
the major functions of religion and ethical philosophy has been to help 
man meet his existential perplexities, and in their attempt to establish 
and preserve their professional identity, psychologists have tended to 
Ignore not only the traditional solutions but the very problem itself 
Typical IS the remark of a young climcal psychologist ‘‘Yes, it is 
certainly true that persons in psychotherapy often speak of death and 
Its personal imphcations for them, but at this point I keep quiet or 
else just ‘reflect’ what they have said ” 

Within recent decades there has been a tendency to assume that 
preoccupation with the problem of death is a sign of “morbidity"’ and 
that It IS of no concern to an emotionally healthy individual It is indeed 
true that when life itself is going well, death often seems remote, un- 
real, and that it looms largest in our thoughts w hen we are physically 
ill or emotionally troubled But death is also a problem for the physically 
and emotionally healthy person, and one of the reasons that con- 
temporary men and women are again turmng to religion in such gieat 
numbers seems to be that here death and death feai are recognized 
as being as normal as they are common 

Thomas Aquinas begins his book. My Way of Life, with this state- 
ment of what IS in many ways the human problem 

The road that stretches before the feet of a man is a challenge to his heart 
long before it tests the strength of his legs Our destiny is to run to the edge 
of the world and beyond, off into the darkness sure for all our blindness, 
secure for all our helplessness, strong for all our weakness, gaih in love for 
all the pressure on our hearts (p i) 

To what extent can “learmng theory,” as we now know it, contribute 
to a better understanding and a more courageous confrontation of this 
emgma^’ It is perhaps premature to reply, “Not at all,” for this is a 
matter to which most learmng theorists, as such, have given scant 
attention Perhaps new and profound insights will indeed be forth- 
coming here— a possibility to which we must not entirely close our 
minds But so long as the investigation of learning mechanisms is tied 
to the infrahuman orgamsm, just so long, it appears, will \ve fail 
to encounter the crisis which has now been with man since the dawn 
of recorded history — and probably for thousands of years before that 

And what has man done with this problem? With other living or- 
gamsms he shares many, many characteristics, truly he is a part of the 
Ammal Kingdom But only man is religious, and this characteristic 
reflects, specifically and uniquely, his efforts at “salvation,’ following 
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Adam’s ‘‘fall ” Or, should we say, following man’s me to the point of 
being god-like in his intelhgence and awareness, but still all too human 
in his mortahty? (See Fromm, 1955 ) 

How, then, does religion cope with this problem^ It has, for one 
thing, offered man the hope of survival and immortality m another 
wo? Id However sympathetic and reverent one may be toward this 
hope, It is not easy to see how psychology, with its present concepts 
and methods, can articulate with it That is to say, it cannot give us 
evideiice of the vahdity of this expectation This is literally a meta- 
physical solution, and psychology, as science, deals only with the 
palpable, or at least the observable 

But there is another aspect of religion, the social aspect, with which 
psychology can, if it chooses, articulate Here the etymology of the 
word Itself is instructive It comes, we find, from the Latin word, 
religio, meamng “to hold back, bind fast,” and from hgare, meaning 
“to bind,” the latter giving us such words as ligament and ligature, 
meamng a fastening, bandage, or bond {Webstefs Unabridged Dic- 
tionary) 

And ]ust how does religion, that “blest tie that binds,” operate^ It 
ties, binds, relates man to God and his fellowmen and in so doing 
holds back the intolerable loneliness and despair that otherwise may 
arise from the fact of his fimtude (Tillich, 1953) Due to man’s “dis- 
obedience,” God has withdrawn from his sight, so that man may know 
Him only indirectly, through prayer and other forms of worship, but 
the opportumty for loving service to other human beings is tangible 
and ever-present How interesting it is that after the account of man’s 
Fall in Genesis comes the story of Cam and Abel, from which we 
learn that man can survive physically and psychologically, only if he 
becomes his “brothel’s keeper,” concerned, compassionate, generous, 
helpful, related 

In the pursuit of relatedness man is counseled to do many things 
which, from a biological frame of reference, sound paradoxical He is 
told that he does not “hve by bread alone,” that he must “turn the 
other cheek” and “go the second mile ” He must be reconciled with 
his neighbor before the sun goes down, and he must give generously 
and be a doer of good works He must love his neighbor as himself and 
— most enigmatic of all — must “lose himself to find himself ” 

Psychoanalysis, while under Freud’s own leadership, was not only 
implacable in its opposition to religion as practice, it even demed its 
implicit premises Death was not the ultimate test of human character 
and courage, man was said to have an “instinct” for it But, from the 
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beginning, this doctrine was questioned by otherwise faithful follow eis 
of Freud, and among latter-day neo-Freudians one finds many taking 
a position that seems much closer to the “illusion” w hich Freud thought 
had such an unpromising future than to Freud’s own conjectures Foi 
example, in Erich Fromm’s book, The Sane Society (1955), we find 
this poetic and insightful passage 

The aim of life is to live it intensely, to be fully born, to be fully awake 
To emerge from the ideas of infantile grandiosity into the con\iction of 
one’s real though limited strength, to be able to accept the paradox that 
every one of us is the most important thing there is in the unnerse — and 
at the same time not more important than a fly or a blade of grass To be 
able to love life, and yet to accept death without terror, to tolerate un- 
certamty about the most important questions with w hich life confronts us — 
and yet to have faith in our thought and feeling, inasmuch as they are truly 
ours To be able to be alone, and at the same time one with a lo\ed person, 
with every brother on this earth, with all that is alue, to follow^ the voice 
of our conscience, the voice that calls us to ourselves, \et not to indulge in 
self hate when the voice of conscience was not loud enough to be heard and 
followed The mentally healthy person is the person w^ho lives by love, 
reason and faith, who respects hfe, his own and that of his fellow^ man (p 
204) 

If, in the present book, learning theory appears to have achieved 
some degree of maturity at the level of the “animal model,” w^e must 
remain modest indeed in face of the larger, infinitely more challenging 
problem that of showing the continuity, if continuity there be, between 
those psychological processes which are common of man and beast 
and those capacities and concerns which we see only at the human 
level It may be that the precepts which have been worked out over 
the ages for an abundant life of the spirit can be derived, with further 
analysis, from principles that hold for biological adjustment, thus re- 
solving the numerous paradoxes previously mentioned But until this 
is done, our faith that it can be done must be tentative, and the assump- 
tion that there is really no problem here is one which, however justifiable 
as a temporary expedient, cannot be indefimtely held by a science that 
aspires to a comprehensive knowledge of man 
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and learning, 325 
measurement of, 309, 312 
perception of, 327 
and probability, 357 
problem of definition, 329 
psychologically considered, 327 
quantification of, 298, 312 
and S — R psychology, 348 
unambiguous, 298 
Cause, and effect, 262, 299, 326 
Cell assemblies, 205 
Certainty, degrees of, 353 
threshold of, 335 
Chain reflexes, 10 1 
Chance, as experimental error, 303 
games of, 305 
as Ignorance, 300 
meaning of, 298 

and multiplicity of variables, 3 1 1 
not irreducible, 302 
a psychological phenomenon, 301 ff 
as uncontrolled causes, 299, 301 
as unperceived causes, 303 
and the Weber-Fechner function, 304 
Change, capacity for, 350 
Character, 390 ff 
Child rearing, and guilt, 392 
and learning principles, 391 
Choice, 179 
and thought, 2 1 1 
unavoidable, 3 14 
and VTE, 215 ff 
Circuits, self-exciting, 263 
Circular reflex, 10 1 
Class system, 365 
Coding, 276 

Coefficient of utility, 324-325 
Cognition, 3 
and affect, 349 
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an element in meaning, 165 
limitations of, 171 
and VTE, 216 
Cognime dissonance, 203 ff 
unpleasant, 206 
Cognime learning, 314 
Coincidence, 224 
(see also Chance) 
Communication, iiyff 
through releasers, 373 
unlearned, 371 

Community, and instinct, 373 
Competence, social, 370 
Competition, 361, 383 
between indniduals, 184 
between responses, 184 
Comprehension, 174 
Compulsions, 203 
and habit, 203 

and observing icactions, 202 
reinforcement of, 203 
Computers, 275 
Concealment, 415 
Concept formation, 23 1, 239 ff 
and classification, 239 
further defined, 240 
and mediated similarity, 245 
and predication, 239 
and symbol use, 241 
Concepts, 206 
and categories, 241 
Conditioned reflexes, 2 
Conditioning, a\oidance, 387 
backward, 143 
and causation, 326 
classical conception of, 37 
cogniti\e, 289 
configurational, 153 
differential, 63 

and doctrine of consequences, 35 

emotional, 4, 289 

first-order, 7 

generalization of, 43 

higher-order, 54 

of images, 17 1 

and intelligence, 124 

inter animal, 388 

and meming, 1 18 

by means of symbols, 223 


mediated, 2 1 
of mediators, <59, 148 
second-order, 7 
and signaling, 2 
social, 360, 387 

and type-2 secondary reinforcement, 
8 

verbal, 341 
Confession, 413, 415 
and expiation, 203 
Confidence, levels of, 310 
Conflict, 17, 349 
insoluble, 199 
and punishment, 5 
in a servo-system, 279 
social, 383 
theory of, 17 
and VTE, 215 
Confounding, 320 
Connectionism, 100, 179 
repudiated, 10 
weaknesses of, 287 
Connections, neural, 10 
Conscience, 206, 390 ff , 402 
and biology, 395 
components of, 403 
and conflict, 394 
constantly reinforced, 408 
and defiance, 409 
and identification, 393 
mduidual differences in, 401 
and reinforcement, 409 
and social reality, 408 
test for, 400 
voice of, 408, 419 
as watchdog, 393 
Consciousness, 179, 252 ff 
biological importance of, 254 
how produced, 253 
and learning, 288 
localization of, 252 
new interest in, 252 
physical correlates of, 253 ff 
representational theory of, 257 
social aspect of, 249 
and VTE, 215 

Consequences, anticipation of, 216 
doctrine of, 35, 37 
Contiguity, 326 
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Contiguity {continued) 
and causation, 328 
versus effect, 349 
and motivation, 169 
Contiguity learning, 4 
Contiguity theory, 167, 287 
Control, automatic, 261 
by negative feedback, 263 
Control systems, 12, 261 ff 
open and closed, 262 
Controls, in research, 295 
Conviction, 347 
Co-operation, 361, 370 
and antagonism, 380 
and releasers, 372 
Copying, 103 
Correlation, 320 
and causation, 324 
as measure of causation, 322 
reliability of, 322 
Counterconditioning, 16, 177 
Countermotivation, 225 
Counting, 62, 154, 242 
Creativity, 290 
Critical periods, 373 ff , 378 
Cues, 107 

external and internal, 213 
as reinforcers, 187 
Culture, 370 

Curiosity, and fear, 365, 367 
Cybernetics, 12, 74, 185, 252 ff , 260 
a boon to behaviorism, 264 
as an integrating conception, 275 
meaning of, 267 
an organizing principle, 274 
and volition, 284 

Danger, discovery of, 19 1 
Danger signal, helpful, 194 
Data, contamination of, 320 
Deaf, education of, 85 
Death, 416, 419 
Deception, 409, 41 1 
Decision, 3 1 3 ff 
and action, 349 
and risk, 314 
through VTE, 216 
unavoidably subjective, 3 17 
and values, 3 16 


Decision theory, 316, 325 
and ordinary choice, 315 ff 
Deduction, and classification, 230 
and induction, 352 

Delayed reaction, after anesthesia, 227 
and brain lesions, 229 
and interpolated activity, 227 
with nonspatial cues, 228 
and posture, 226, 229 
and species complexity, 226 
and symbolic processes, 226 
Delayed reinforcement, 26 
Demands, as secondary reinforcement, 
183 

Dependency, and conscience, 393 
mutual, 381 
and obligation, 393 
Depression, 206 
Deprivation, social, 390 
Desynchronization, 253 
Determinism, 347, 350 
Diads, 368 

Disappointment, 17, 24 
Discipline, 83 
over-done, 406 
types of, 405 
Discovery, 247 

Discrepancy, and feeling, 206 
and self -regulation, 220, 278 
Discrimination, 27, 388 
in avoidance learning, 400 
and control, 304 
and extinction, 337 
generalization of, 245 
mediated, 63 
and transposition, 244 
and VTE, 213 

Discrimination hypothesis, 19 
Dissociation, cognitive, 413 
of image and affect, 412 ff 
Distance receptors, 1 86, 221 
Docility, and learning, 367 
Dogs, origin of, 381 
relationship with man, 381 
Doing, and sensing, 180 
Domestication, 128 
and group life, 378 ff 
and socialization, 380 
Dominance, reversal of, 389 
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and social order, 380 
Dominance hierarchies, 360 
Doubt, and thought, 216 
Dreaming, 251, 254 
Dri\e, 107 

Drue decrement, ii, 167 
Drive increment, 1 1 
Drues, secondary, 180 

Economic man, 345 
Education, definition of, 162 
Effect, \ crsus contiguity, 349 
Effects, from imperceptible causes, 303 
Eicomcs, 172 

Electric shock, signal function of, 202 
Emotion, versus cognition, 165 
effect on memory, 173 
an image of value, 165, 259 
as a mediator, 259 
and reason, 217 

Emotions, and control of behavior, 17, 
217 

an ecology of, 24 
language of, 158 
as mediators, 69, 217 
voice of the unconscious, 289 
Empathy, 1 15, 389 
Emphasis, \ ersus punishment, 345 
Empiricism, as induction, 330 
manifesto of, 330 
and objectivity, 330 
En\ ironment, causal texture of, 330 ff 
natural, 331 
Epilepsy, 255 
Epistemology, 314-315 
Equally-occurring e\ents, postulate of, 
306 

Equilibrium, moi al, 395 
Error, two types of, 305 
Erroi actuation, and homeostasis, 275 
Error actuation, 180, 220, 263 
Error variance, 300 
Evidence, versus plausibility, 357 
Evolution, and beha\ior, 183 ff 
and learning, 2 
social, 395 
theory of, 2 
Excitability, 254 
Existence, enigma of, 417 


struggle for, 2 
Existentialism, 416 ff 
Expectation, cognitive, 206 
emotional, 206 

Experience, internationalization of, 346 
Experimentation, errors of, 302 
and statistics, 300 
Expiation, 398 
Exploration, 181 
Extinction, 16, 407 
in conditioning, 337 
and counterconditioning, 177 
and discrimination, 337 
and frustration, 19 
and generalization, 27 
misconceived, 19 
paradoxical resistance to, 343 
and punishment, 344 
theories of, 58, 182 
without performance, 59, 61 
Eyes, as symbols, 406 

Faculty psychology, 208, 350 
Family life, 371 
Fantasy, 81 

Fatigue, and extinction, 182 
Fear, and activity, 366 
cognitive level in, 289 
communication of, 389 
and exploration, 192 
greater after tabooed act, 397 
induced by behavior, 396 
as an intervening variable, 68 
long-term advantage of, 195 
offset by positive cathexis, 366 
reduced by punishment, 20 1 
retrospective, 396 
unrealistic, 406 
Feedback, 85, 252 

application to learning neglected, 273 

delayed auditory, 281 

elimination of, 281 

excessive, 268 

and habit, 179 

inconsistent, 281 

negative, 220 

principle of, 263 

and the principle of effect, 264 

and representation, 274 ff 



462 


SUBJECT INDEX 


Feedback {continued) 
and response initiation, 279 
sensory, 102 
tightness of, 276 
two theories of, 269 
Feedback systems, hierarchy of, 274 
Field theory, 1 1, 25 
Fighting, 371 
reproductive, 371 
Finitude, human, 418 
Foresight, 12, 39, 51, 124 
and conditioning, 43 
as generalization, 66 
Forgetting, 170 
and conflict, 225 
Free will, 350 

Freedom, as capacity to change, 351 
and determinism, 347 
increased by thought, 2 1 1 
nature of, 350 
not lawlessness, 350 
and responsibility, 350, 370 
Frequency, principle of, 265 
Frontal lobes, 227 
Frustration, 17, 24 
adaptive, 364 
effectiveness of, 2 1 
and extinction, 19-20 
intermittent, 345 
nullified by reward, 345 
and problem solving, 363 
Functional autonomy, 408 
Functionalism, 249 

Gambling, 398 
fascination of, 305 
Games, 301 ff 
of chance, 304 
of skill, 304 

General semantics, 123, 160 
Generalization, 147, 326, 388 
and classification, 241 
and logical inference, 238 
mediated, 63 
once-always, 27 
one-many, 27 
semantic, 143, 146, 223 
through homophones, 56 


through similarity, 29 
through synonyms, 56 
unconscious, 290 
Generalization gradient, 26 
Gestalt psychology, 172, 236, 249 
Gestures, 88, 107, 15^ 
m lieu of language, 160 
as social acts, 89-90 
as truncated habits, 89 
vocal, 156 

Goal responses, anticipatory, 39 
Goal seeking, 10 
Gratitude, 409 
Group cohesion, 381 
Group dynamics, 381 ff 
Group formation, 379, 381 
Group integrity, 380 
Guilt, 390 ff 
analysis of, 393, 396 
and deception, 41 1 
and detection, 41 1 
experimental study of, 393 ff 
false, 406 
and grace, 395 

laboratory paradigms, 395 ff 
lack of research on, 391 
management of, 406 
and masochism, 201 
not easily resolved, 415 
and presence of another, 403 
summary analysis, 404 ff 
and trainer avoidance, 404 
Guilt feeling, 405 

Habit, bond conception of, 27 
a closed circuit, 269 
feedback theory of, 9 ff , 27, 2 1 1 
as hope, 10 
new theory of, 7 

and secondary reinforcement, 21, 61 
as self-imitation, 1 14 
and sensory feedback, 182, 281 
theory of, 2, 1 12 
Habit formation, 14 
Habit theory, and imitation, 112 
Hallucination, 167, 204, 255 
self -punishing, 206 
Hand washing, 202 
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Head, location of, 221 
receptors in, 221 

Hedonism, immediate and delayed, 345 
Heredity, and intelligence, 367 
Hiding, 409 

Hierarchy, ascendancy-submission, 380 
dominance-submission, 361 
Homeostasis, 260-261 
achie\cd by feedback, 272 
and masochism, 200, 202 
and obscr\ing reactions, 195 
and social concern, 394 
Homeostat, 271, 276 
self-correcting, 272 
Honesty, and psychopathology, 411 
Hope, 24 
and fear, 8, 10 
generalization of, 177 
and habit, 10 
and insight, 234 
Hostility, suppressed, 380 
Human condition, 416 
Humphreys effect, 1 8 ff 
Hunger, as a conditioned stimulus, 287 
and hungei fear, 160 
Hypnosis, 255 
Hypothesis, statistical, 3 1 2 
testing, 3 1 2 

Hypothesis rejection, a false strategy, 
312 


Ideal pattern, 278 
Ideas, association of, 329, 347 
as images, 329 
source of, 330 
Ideational content, 290 
Identification, 79, 112, 346 
across-spccies, 377 
of individuals, 388 
Illusion, spatial, 282-283 
Image, a conditioned sensation, 166 
definition of, 166 
factual, 165 

how differentiated, 204 
and performance, 180 
projected, 204 
as a standard, 180 
as a vicarious presence, 258 


Imagery, 164 ff , 165, 247 
in animals, 159, 372 
and concept formation, 174 
and conscience, 406 
and drive intensity, 287 
and guilt, 392 
implications of, 203 
and knowledge, 347 
reality of, 174 
and skill, 172 
theory of, 166 
varieties of, 205 
in Weinstock experiment, 177 
Images, 158, 203 ff 
as analogies, 276 
conditioned to drives, 286-287 
conditioning of, 329 
and hallucination, 167 
as mediators of emotion, 17 1 
not just visual, 174 
as reference levels, 287 
representational function of, 205, 259 
of values, 165 
Imagination, 167, 173 
and thinking, 205 
Imitation, 72 ff , 109, 346 
of affect, 1 15 
in animals, 98 ff 
and autism theory, 107 
and autistic satisfaction, 75 
in birds, 98 

in the chimpanzee, 108 ff 
and conditioning, loi ff 
and copying, 103 
delayed, 109 

and discrimination learning, 107 

generalization of, 106 

and habit, 112 

and identification, 112 

inadequate theories of, 104 

instinct of, 74 

and language, 104 

as latent learning, 74 

mutual, 104 

not instinctive, 1 10 

Piaget’s theory of, 103 

as play, 109 

and primary reinforcement, 76 
proficiency in, 100 
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Imitation (continued) 
and punishment, 1 14 
and reflex circle, 10 1 
reverse, 106 

and secondary reinforcement, 80 
and theories of learning, 107 
theory of, 98 ff 

as viewed by Thorndike, 97 ff 
views of animal trainers, 99 
Immediate memory, 26 
Imprinting, 373 ff 
experimentally studied, 375 
and learning, 376 
not irreversible, 376 
Inattention, selective, 413 
Incongruity, and curiosity, 205 
and fear, 192 
unpleasant, 205 

Inconspicuousness, advantage of, 126 
Incorporation, of reward and punish- 
ment, 346 

Induction, and deduction, 352 
Inference, 231 
logical, 356 
and mediation, 356 
in rats, 238 

through sensory generalization, 238 
Information, 124, 14 1 
versus action, 181 
and learning theory, 187 
and lessened frustration, 189 
maximizing of, 340 
receipt of, 180 
as reinforcement, i88, 265 
as a social act, 162 

Information theory, 123, 138, 160, 185 
and probabilistic learning, 340 
In-group, 379 
Inhibition, by foresight, 40 
and guilt, 397 
of responses, 1 1 
Innervation, feeling of, 285 
Insight, 208 ff , 230 ff 
analysis of, 233 
as deduction, 230 
and foresight, 39 
and hope, 234 
and latent learning, 66 
and learning, 7, 12, 230 


nonfunctional, 41 
as rapid learning, 95, 33 1 
as sight, 234 
Instinct, 373 
feedback theory of, 223 
and imitation, 74 
versus learning, 374, 386 
nature of, 222 
Instincts, 221, 331, 370 ff 
and species, 386 
Instruction, 13 1 
Integration, group, 382 
neural, 256 
perceptual, 283 
Intellect, and emotion, 216 
Intelligence, 124, 180, 206 
in machines, 220 
and social experience, 367, 390 
Intent, 409 

Interaction, and learning, 382 
reciprocal, 382 ff 
social, 364-365 

Interdependence, and self-regulation, 
262 

Interest, 169 
Interests, 25 
Intermediation, 14 1 
Intermittent reinforcement, 334 
and causation, 331 
and frustration eff ectiv eness, 20 
Internalization, 394 
of experience, 346 
of training, 390 
Interpretation, 4 1 3 

Interval, between CS and UnCS, 329 
Intervening variables, 68, 252 
Intimidation, 371 
Introspection, i ff 
Introspectionism, 249 
Invention, 251 
Inverse feedback, 264 
Investigatory reflex, 192 
Isolation, destructive, 393 
Isomorphism, 346 

Jealousy, 380 

and dependence, 394 
Judgments, of others, 408 
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Knowledge, 124, 141, 170 ff, 180 
and imagery, 172 
learning and reality, 345 ff 
not innate, 330 
as a replica, 346 
representational theory of, 346 

Knowledge of results, 265 

Labeling, 2 3 1 

Labeling reaction, 147 

Language, and abstraction, 12 1, 126 
and affect, 96 
and altruism, 162 
in animals, 1 2 1 

babble-luck theory of, 72, 91 
of bees, 132 
in chimpanzees, 1 10 
and cooperation, 90 
definition of, 155 
dispositional theory of, 154 
dynamics of, 1 17 ff 
emotional, 158 
essence of, 152 ff 
and expression of thought, 138 
functions of, 86, 1 18 ff , 1481? 
and imitation, 72, 97 ff 
and infantile dependence, 90 
informati\ e \ ersus instrumental as- 
pects of, 91 
and learning, 1 17 ff 
marvels of, 157, 162 
and natural sounds, 96 
neurological bases of, 160 
origin of, 86 ff 
from play to work, 80 
and predication, 134 
propositional, 1^8 
repetition in, 224 
and representation, 80 
and secondary reinforcement, 73 
and signs, 125, 136 
subjeemely considered, 122 
a substitute for action, 90, 1 19 
a substitution for stimulation, 119 
as a system, 153 
and tense, 136 
theories of, 1 17 ff 
and trial and error, 72 
why not um\ ersal, 97 


Language learning, 70 ff 
Latent extinction, 58 ff 
of habits and inhibitions, 59 
and secondary reinforcement, 61 
Latent learning, 29 ff 
defined, 45 ff 
early studies of, 30 ff 
and empathy, 389 
and extramaze cues, 50 
and imitation, 74 
and insight, 39 

versus learning by doing, 7, 12 
and partial reinforcement, 61 
and place learning, 50 
and putting through, 1 15, 389 
and secondary reinforcement, 49 ff 
Seward’s work on, 45 ff 
Latent punishment, 34 ff , 48 
Law of effect, 10, 13, 17 
and feedback, 264 
and intelligence, 267 
nonrepresentational, 258 
and thought, 210 
Laws of chance, 307 
Leadership, 103 
in sheep, 376 

Learning, brain localization of, 255 
and causation, 325 ff 
both cognitive and emotional, 291 
as conditioning, 16 
and determinism, 349 
distinct from doing, 2 1 1 
by doing, 12, 92 
entirely cognitive, 17 1 
and evolution theory, 183 
as freedom, 351 
and generalization, 27 
a gradual process, 332 
and group life, 379, 382 
incidental, 288 
indexed by PGR, 169 
as induction, 230 
inherently probabilistic, 331 
as inorganic evolution, 184 
and insight, 230 
and interest, 169 
and knowledge of results, 265 
mathematical, 246 
mediated, 21, 132 
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Learning {continued) 
nature of, 216, 350 
by observing, 192, 227 
optimum rate of, 332 
psychology of, 359 
by putting through, 75 
role of reality and reward, 336 
S — S theory of, 169 
as self-correction, 272 
social, 359 ff 
survival value of, 1 84 
and thinking, 222 
through discovery, 247 
two levels of, 185 
types of, 15 
as ultrastability, 222 
and the unconscious, 288 ff 
and variability of environment, 331 
vicarious, 115, 132, 183, 351 
versus wiring-m, 221 
without awareness, 288 
without domg, 7, 51, 66, 76 
without reinforcement, 168 
Learning machines, 271 
Learning rate, and statistical error, 333 
Learning sets, 100 
Learning theory, and guilt, 391 
and neurosis, 359 
scope of, 419 

and servomechanisms, 260 ff 
Least action, law of, 90 
Level of aspiration, 278, 3 18 
Logic, and scientific method, 352 
Loyalty, 393 
and conscience, 394 
Lymbic system, 255 

Machines, self-regulating, 180, 260 
that learn, 271 
Magic, 328 
Malconditioning, 407 
Man, knowledge of, 419 
nature of, 348 

Masochism, and compulsions, 200 ff 
experimental paradigm of, 202 
Mastery, concept of, 192 
Matching, and correction-noncorrection, 
337 

versus maximizing, 336 


of objective probabilities, 336 
Mathematical models, 310, 315 
limitations of, 316, 352, 358 
and the real world, 3 16 
Mathematics, learning of, 247 
psychology of, 242 ff 
strategy of, 308 

Maximizing, in human beings, 342 
increased by punishment, 344-345 
of information, 340 
versus matching, 336 
and motivation, 343 
and perception of task, 341 
of reward, 334 
Aleanmg, 56, 124, 164 ff 
acquired by conditioning, 7 1 
behavioristically conceived, 120 
bucket theory of, 140 
cognitive aspects of, 164 
and context, 153 
dispositional theory of, 175 
and emotion, 130, 164 
evaluative, 71, 164 
and imagery, 173 
as a mediator, 148 
motor theory of, 173 
origin of, 96 
problem of, 118 
quantification of, 160 
transfer of, 137 ff 
Meanings, 3 
communication of, 138 
imaginal, 153 
nonemotional, 173 
origin of, 88 
transfer of, 139 

Mediated discrimination, 62 ff 
empirical, 63 
Mediated similarity, 241 
Mediating response, 146 
Mediation, 116, 160 
always sensory, 65 
and behavior complexity, 70 
by a common element, 246 
concept of, 29 ff 
of discrimination, 66 
by emotions, 2 17 
empirically substantiated, 57 
and habit, 70 
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implies equivalence, 276 
and intermediation, 141 
and intervening variables, 68 
a key concept, 152 
and latent learning, 66 
in mathematical skill, 246 
mechanism of, 34 ff 
nonfunctional, 41 
place-produced, 5 1 
in reasoning, 238 
rejection of, 153 
and representation, 228, 259 
response-produced, 51 
role of, 150 

and sentence function, 143 ff , 159 
and symbolization, 67 
and teaching, 57 
in time, 67 
two levels of, 69 
two theories of, 57 
with two types of stimuli, 65 
Meditation, 416 
Memory, 124, 170 ff 
in animals, 177-178 
dissociation of, 413 
electrically aroused, 255 
and emotion, 173 
and imagination, 259 
Mental illness, beha\iorally interpreted, 
411 

as moral inadequacy, 410 
Mentality, human, 372 
Mind, origin of, 156 
Minds, and machines, 270 ff 
Misbehavior, 41 1 
Models, 350 

in imitation and habit, 1 1 3 
limitations of , 3 1 1 
mathematical, 3 1 1 

(see also Mathematical models) 
push-button, 12 
theoretical, 260, 3 1 1, 3 19 
theory of, 3 15 
Mortality, 416 

Mother, as speech teacher, 83 
Motivation, as a discrepancy, 220 
and maximizing, 343 
primary, 180 

Movement, feeling of, 28<) 


sensations of, 179 
Music, 245 

Naming, 87, 157 

Natural selection, and trial and error, 
184 

Needs, primary and derived, 234 
Nervous system, activity of, 256 
Neural activity, circular, 268 
Neurosis, experimental, 387 
as loss of freedom, 351 
Nonconfirmation, 58 
Nonimitation, 106 
Nonreward, as disappointment, 344 
and extinction, 365 
a form of punishment, 345 
Normal distribution, assumption of, 3 1 1 
Normal thought, and obsession, 203 
Nouns, and propositions, 159 
use of, 136 

Null hypothesis, 307-308 
limitations of, 3 12 ff , 324 
rejection or acceptance, 3 13-3 14 
Number behavior, 242 

Objectivity, fiction of, 3 18 
Objects, vicarious presence of, 258 
Obligation, 393 

Observing reactions, 49, 187 ff 
advantages of, 195 
as avoidance behavior, 19 1 
and avoidance learning, 192 
habit strength of, 198 
and other behavior, 193 
paradox of, 189 ff 
reward for, 190 
in situations of danger, 189 ff 
theory of, 192 
in wild animals, 190 
Onomatopoeia, 93 ff 
Organisms, as social stimuli, 389 
Oscillation, uncontrollable, 268 
Overgeneralizmg, 124 

Pam, pleasure in, 202 
Partial reinforcement, Amsel-Wein- 
stock hypothesis of, 175 
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Passive avoidance, 6 
Pavlov, theories of, 3 ff 
Pecking order, 380 
Perceiving, and behaving, 18 1 
Perception, 187 
versus behavior, 185 
conflict in, 282-283 
disorganization of, 282-283 
and observing reactions, 197 
and reinforcement, 283 
stability of, 200 
substitute for exploration, 186 
veridicality of, 198 
Perceptual defense, and conflict, 199 
and response inhibition, 200 
Perceptual \igilance, and defense, 197 ff 
Performance, 180 
principles of, 318 

Peripheralism, versus centralism, 256 
Personality, 359 ff , 390 ff 
and social learning, 369 
Phase sequences, 203 ff , 205 
Philosophy, moral, 416 
Place learning, ii, 25, 213, 260 
and latent learning, 50 
positive and negative, 9 
Planning, 228 
as delayed reaction, 225 
Plans, 416 

Power, concept of, 323 
Preconditioning, 168 
Predication, 130 ff 
basis of language, 81, 135 
and conditioning, 140 
denied, 153, i6o 
and thought, 224 
Probabilistic discrimination, 339 
Probabilistic learning, 331, 333 ff , 334 ff 
in rats and men, 339 ff 
and reinforcement theory, 334 
Probability, 325 ff 
versus causation, 357 
and conviction, 347 
disagreement on, 3 10 
discrimination of, 344 
and information, 332 
mathematical approach to, 305 
mathematical definition of, 306 


meanings of, 353 ff 
normal curve of, 306 
psychophysics of, 335 
and rate of learning, 332 
a self-contradiction, 357 
subjectivity of, 3 19 
theory of, 295 
threshold of, 335 
two conceptions of, 351 ff 
Probability learning, in animals, 343 ff 
Probability theory, controversial, 352 
Problem solving, 251 
insightful, 227 
social, 362 ff 
temporal, 227 

Propositions, and probability, 353 
Pseudo-conditioning, 168 
Psychoanalysis, 25, 406, 418 
fallacies of, 407 

Psychology, and engineering, 270 
and morality, 395 
as science, 348 
social, 383, 414 
Psychopathology, 199, 359 
conflict in, 415 
endemic, 414 
interpersonal basis of, 412 
moral nature of, 414 
and social isolation, 415 
Psychopathy, in dogs, 402 
Psychosis, 206 
Psychotherapy, 408, 410 
strategy of, 413 

Puberty, and change of voice, 128 
Punishment, 3 
and character, 405 
by conscience, 398 
delayed, 403 
dread of, 397 
as emphasis, 345 
feedback conception of, 7, 2 1 1 
further analyzed, 397 
and imitation, 1 14 
intermittent, 345 
secondary, 149 
social, 361 
theory of, 5 

Pure-stimulus acts, 56, 67, 69, 2i4ff , 227 



SUBJECT INDEX 


469 


and choice, 214 
and reasoning, 2 14 
Purpose, 332 
Purpose tremor, 268 
Putting through, 1 15, 389 
and imitation, 100 

Quasipredication, 130 

Random errors, 320 
Randomness, laws of, 307 
Rationalization, 409 
Rawin set, 218, 414 
Reaction, circular, 103 
delayed, 225 

Reactions, schizophrenic, 410 ff 
Reacme inhibition, 181 
Realism, basis of, 347 
rewarding, 194 
Reality, the push toward, 287 
Reality principle, 200 
Reasoning, 40, 356 
and concept formation, 236 ff 
mathematical, 242, 246 
and mediation, 238 
in rats, 236 
in VTE,2I4 
Reassurance, social, 366 
Reclassification, 239 
Reconditioning, 145 
Redefinition, 145 
Redemption, 412 
Reference levels, 274 
and error actuation, 277 
as images, 275 

and le'vels of aspiration, 287 
Reference signals, 28^ 

Reflex, an open circuit, 269 
psychogalvanic, 169 
Reflex arc, 2, 178 ff 
an inadequate model, 179 
part of a circuit, 1 79 
Reflex chaining, 179 
Reflex circle, 102 
Reflexes, 64, 331 
Reflexology, 179 
inadequacies of, 349 


Regret, 396 

Rehabilitation, moral, 410 
Rehearsal, subvocal, 224 
Reinforcement, decremental and incre- 
mental, 344 

double-intermittent, 22 
gradient of, 26, 29, 328 
intermittent, 18, 398 
nature of, 16 
secondary, 234 

and sensory conditioning, 169 
social, 290, 409 
and symbolism, 350 
two forms of, 1 1 
types of, 15 

Reinforcement delay, and secondary re- 
inforcement, 235 
Reinforcement theory, 167 
Relatedness, rupture of, 407 
Relaxation, versus arousal, 254 
between trials, 194 
Releasers, 372-373 
and learning, 373 
Relief, 17 
symptomatic, 202 
Remorse, 392 
Repetition, 265 
Repetitiveness, 351 
and compulsions, 203 
Representation, 227 
and abstraction, 259 
and conditioning, 258 
and consciousness, 257 ff 
Repression, 199,413 
Resemblance, 326 
Resentment, 409 

Resistance to extinction, paradoxical, 
18 ff 

Response, 107 
baiting of, 93 
cue-producing, 62, 154 
facilitation of, 1 1 
miniature, 214 
selection of, 183, 288 
suspension of, 229 
symbolic, 214 

Response generalization, 27, 29 
Response initiation, 279, 283 ff 
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Response learning, 260 
and place learning, 5 1 
Response mediation, 40, 15 1 
(see also Mediation) 

Response substitution, 2 
Responsibility, 350 
moral, 398 
and sanity, 410 
Resting state, 2^6 
Restitution, 409, 412 
Retention, 227 

Reticular formation, 204, 253 
Retribution, 41 1-4 12 
Reverberating circuits, 205 
Reverie, 204 
Re^vard, 107 

Risk, relative to evidence, 3 14 
Risk-tabng, 319 
Role, 385 

Role expectation, 278 

Samplmg, statistical, 355 
Sampling error, 308 
Satisfaction, autistic, 75 
Scansion, of response possibilities, 180 ff , 
287 

Schizophrenia, 410 if 
Science, and causation, 294, 319, 358 
older than statistics, 295 
Scientific method, and logic, 352 
Search, 287 

(see also Scansion) 

Secondary reinforcement, 7, 14 
generalization of, i ii 
and group cohesion, 384 
and habit, 2 1 
and habit strength, 61 
as “hope,” 7 ff 
and insight, 235 
and language learning, 73 
and leadership, 377 
nature of, 22 

and social experience, 390 
type- 1, 23 
type-2, 20 ff 

Secondary reinforcements, and informa- 
tion, 266 
Sedatives, 255 


Segmentalism, versus globalism, 256 
Self-control, 392 
Self-determination, 351 
Self-esteem, 393 
Self-examination, 416 
Self-imitation, 1 14 
Self-punishment, 347 
cognim e, 206 
Self-regulation, 261 
and learning, 269 
in machines, 180 
Self -reward, 347 
Semantic differential, 164 
Semantic generalization, 54, 66, 15 1 
Sensations, and images, 167, 204 
and mo\ement, 179 
proprioceptive, 268 
Sense organs, ad)ustments of, 187 
Sensing, and doing, 180 
Sensitization, 168 
Sensory conditioning, 53 
Sensory exploration, as substitute be- 
havior, 184 

Sensory feedback, essential to behavior, 
272 

(see also Feedback) 

Sensory preconditioning, 55, 168, 207 
Sensory search, 180 ff 
Sentences, 8r, 224 
action of, 143 
analysis of, 137 ff 
as complex signs, 1 40-1 41 
a conditioning device, 14 1, 147 ff , 15 1 
of one word, 1 3 1 
psychology of, 1 17 ff 
sign-sign type, 15 1 
sign-thing type, 149 
thing-sign type, 133, 149 
thmg-thing type, 149 
Servo-mechanisms, 184, 220 
Servo-theory, and conditioning, 269 
Servo-technology, 260 
Set theory, 243 
Shame, 391, 408 
Sharing, 360 
Sickness, and sin, 412 
Sign-gestalt expectations, 37 
Sign learning, 4 
and law of effect, 35 
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and solution learning, 7 1 
Signaling, 93, 371, 373 
in animals, 125 
and begging, 75 
and quasipredication, i3off 
Signals, 2, 371 

and sentences, 134!? 

Significance, 122 
criterion of, 313 
and number of subjects, 315 
tests of, 320, 323, 325 
Signification, 122 
Signs, as causes, 327-328 
psychology of, 124 
as releasors, 142 

repre‘*entational function of, 124 
and sentences, 1 17 fif 
and signaling, i24ff 
signals and symbols, 1 56 
and superstition, 328 
Similarity, in concept formation, 241 
and generalization, 29 
Sin, as alienation, 407 
and sickness, 412 
Skill, 27, 75, 172, 183 
and discrimination, 277 
games of, 30<? 
and image of action, 285 
Sleep, 253 ff 
necessity of, 254 
risks involved in, 254 
special significance of, 2 ^4 
Social bchav lor, unlearned, 369 ff 
Social class, 365 
Social isolates, 377 
Social learning, 3 18 
and group structure, 386 ff 
Social relationships, experimental con- 
trol of, 390 

Sociality, and thought, 250 
Socialization, and charactei , 402 
critical peioids of, 378 
and learning, 385 
and personalitv^ 390 ff 
two techniques of, 403 
Society, origins of, 385 
Solicitation, 362 
Solution learning, 4 
derived from conditioning, 1 1 


Sound, aversion to, 82 
Spatial cues, dominance of, 229 
Speaking, and hearing, 84 
Speech, acquisition of, 79 
autistic, 121 

biological background of, i24ff 
in chimpanzee, io8 ff 
definition of, 157 
neurological basis of, 74, no 
parts of, 137, 174 
Stability, 272-273 
through feedback, 262 
Statistical inference, from mathematical 
models, 358 

Statistical significance, a variable mat- 
ter, 313 

Statistical utility, 324 
Statistics, versus control, 320, 324 
and decision, 3 1 3 fiF 
descriptive and inferential, 3 10 
of doubtful value, 3 10 
imperfections of, 301, 309 ff 
and law of large numbers, 307 
not elegant, 320 
and probability theory, 354 
and the problem of “noise,” 309 
and scientific method, 357 
skepticism concerning, 358 
and truth, 313 
Status, 385 
Steady states, 260 
Stimulation, communality of, 40 
essential to response, 284 
external, 10 
interoceptive, 39 
mediational, 26 
response-correlated, 9, 102 
re\ erberation of, 26 
Stimuli, proprioceptive, 46 
response-produced, 6, 39, 214 
Stimulus generalization, 27 
Stimulus mediation, 40 
(see also Mediation) 

Stimulus patterning, 14 1 
Stimulus substitution, 2 
Stimulus trace, 26, 177 
Stranger, rejection of, 379 
Structuralism, 2, 208 ff , 249 
Stuttering, 83 
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Subject, and predicate, 137 
Succession, and causation, 328 
Suggestion, i66 

Summaries, 1-28, 64 ff, 115, 137, 217, 259, 

270* 349- 371-372. 391. 404 ff 

Superego, 391, 402 
Superstition, 328, 332 
Syllogism, 238 

Symbol, defined, 152, 156, 161 
Symbolism, absent m animals, 16 1 
and abstraction, 159 ff 
Symbolization, and abstraction, 16 1 
Symbols, 371 
function of, 122 
and imagery, 158 
objective reference of, 158 
in reasoning, 238 
their social nature, 250 
use in thinking, 214 
Synaesthesia, 204 

Tabes dorsalis, 268, 272 
Taboo training, effectiveness of, 402 
Talking birds, 73, 79 ff , 1 12 
imagination in, 277 
lack of true language in, 133 
and Miller-Dollard theory, 107 
neurology of, 1 1 1 
Thorndike’s discussion of, 98 
Talking dogs, 74 
Teamwork, 362 
Teleology, and mechanism, 12 
Temptation, and guilt, 399 ff 
and reaction formation, 400 
resistance to, 403-404 
Terminology, 15, 67, 236 
Territoriality, 128, 380 
Theology, 416 

Theoretical models, analogue computer, 

275 

(see also Models) 

Thermostat, and imagery, 180 
Thinking, and emotions, 216 
mathematical, 247 
primitive, 212 
as self -stimulation, 224 
unsystematic knowledge of, 250 
a varied process, 212, 247 
Thorndike, theories of, 3 ff 


Thought, 208 ff 
and action, 222 
in animals, 209 
as behavior adjunct, 2 1 1 
in delayed reaction, 225 ff 
disorders of, 206 
failure of, 413 
function of, 2 10 
and imagery, 248 
as implicit speech, 209, 249 
and learning, 222, 247 
pathology of, 412 ff 
as planning, 223 ff 
as preconditioning, 223 ff 
a prelude to action, 216 
psychology of, 247 ff 
as token behavior, 222 
without language, 248 
Threshold, of discrimination, 304 
Trace conditioning, 38-39 
Transactions, interanimal, 387 
Transfer, 27, 39, 147 
through a common element, 66, 146 
through mediation, 56 
Transposition, 242 
aided by verbalization, 244 
correlated with age, 244 
and language, 243 

Trial and error, and language, 77, 83 
vicarious, 184, 259 
Truth, a relative matter, 314 
Two-factor theory, application to Ian- 
guage, 72 ff 
and autism theory, 1 1 2 
and choice, 319 
as cybernetic analogue, 267 ff 
and feedback, 273 
and instinct, 222 
and language, 71 
and observing reactions, 195 
power of, 6, ii, 61, 66, loo-ior, 115, 
236, 241, 270, 277 

and probabilistic learning, 334, 345 

and probability, 325 

and Skinner’s position, 77 

and thought, 2 1 1 

and Tolman’s views, 35 

and unlearning, 16 

version one, 3, 6 



